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Abstract. This work considers a many-server queueing system in which cus- 
tomers with i.i.d., generally distributed service times enter service in the order 
of arrival. The dynamics of the system is represented in terms of a process that 
describes the total number of customers in the system, as well as a measure- 
valued process that keeps track of the ages of customers in service. Under mild 
assumptions on the service time distribution, as the number of servers goes to 
infinity, a law of large numbers (or fluid) limit is established for this pair of 
processes. The limit is characterised as the unique solution to a coupled pair 
of integral equations, which admits a fairly explicit representation. As a corol- 
lary, the fluid limits of several other functionals of interest, such as the waiting 
time, are also obtained. Furthermore, in the time-homogeneous setting, the 
fluid limit is shown to converge to its equilibrium. Along the way, some results 
of independent interest are obtained, including a continuous mapping result 
and a maximality property of the fluid limit. A motivation for studying these 
systems is that they arise as models of computer data systems and call centers. 
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1. Introduction 

1.1. Background and Motivation. The main objective of this paper is to ob- 
tain functional strong laws of large numbers or "fluid" approximations to vari- 
ous functionals of the G/GI/N queue, in the limit as the number of servers tends 
to infinity. In fact, a more general setting is considered that allows for possibly 
time-inhomogeneous arrivals. In order to obtain a Markovian description of the 
dynamics, the state includes a non-negative integer-valued process that represents 
the total number of customers in system, as well as a measure- valued process that 
keeps track of the ages of customers in service. The fluid limit obtained is for this 
pair of processes and thus contains more information than just the limit of the 
scaled number of customers in system. In particular, it also yields a description of 
the fluid limits of several other functionals of interest, including the waiting time. 
A fairly explicit representation for the fluid limit is obtained, which is then used 
to study the convergence, as t — > oo, of the fluid limit to equilibrium in the time- 
homogeneous setting. These results are obtained under mild assumptions on the 
service distribution, such as the existence of a density, which are satisfied by most 
distributions that arise in applications. While we expect that these conditions can 
be relaxed, the representation of the fluid limit is likely to be more involved in that 
setting. Thus, for ease of exposition, we have restricted ourselves to this generality. 

Multiserver queueing systems arise in many applications, and have generally 
proved to be more difficult to analyse than single server queues. Thus it is natural 
to resort to an asymptotic analysis in order to gain insight into the behavior of these 
systems. In this work we consider the asymptotic regime introduced by Halfin and 
Whitt in in which the number of servers and, proportionally, the arrival rate 
of customers, tend to infinity. For the case of Poisson arrivals and exponentially 
distributed service times, a central limit theorem for the number of customers in 
system was obtained in [11] . For networks of multi-server queues with (possibly 
time- varying) Poisson arrivals and exponential services, fluid and diffusion limits 
for the total number of customers in system were obtained by Mandelbaum, Massey 
and Reiman in [16] , and these results were later extended to include the queue length 
and virtual waiting time processes in [17] . All of these results were obtained under 
the assumption of exponential service times. 

This work is to a large extent motivated by the fact that G/GI/N queues arise 
as models of large-scale telephone call centers, for which the limiting regime con- 
sidered here admits the natural interpretation of the scaling up of the number of 
servers in response to an analogous scaling up of the arrival rate of customers (see 
[2] for a survey of the applications of multi-server models to call centers). Recent 
statistical evidence from real call centers presented in Brown et. al. [2] suggests 
that, in many cases, it may be more appropriate to model the service times as 
being non-exponentially distributed and, in particular, according to the lognor- 
mal distribution. This emphasises the need to obtain fluid limits when the service 
times are generally distributed. With this as motivation, a deterministic fluid ap- 
proximation for a G/GI/N queue, with abandonments that are possibly generally 
distributed, was proposed by Whitt in [21] . However, a general functional strong 
law of large numbers justifying the fluid approximation was not obtained in [21] 
(instead, convergence was established for a discrete-time version of the model, al- 
lowing for time-dependent and state-dependent arrivals). In this paper, we establish 
a functional strong law of large numbers limit allowing for time-dependent arrivals, 
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but in the absence of abandonments, and provide an intuitive characterisation of 
the limit. Concurrently with this work, fluid and central limit theorems for just 
the number in system were established in the work of Reed [20] using a clever 
comparison with a G/GI/oo system. Here, we take a different approach, involv- 
ing a measure-valued representation that leads to a different representation of the 
fluid limit of the number in system and also yields the fluid limits of several other 
functionals of interest. 

One of the challenges in going from exponential to non-exponential service dis- 
tributions is that a Markovian description of the dynamics leads to an infinite- 
dimensional state. The measure-valued representation and martingale methods 
adopted in this paper provide a convenient framework for the asymptotic analysis 
of multi-server queues (see |22] for a recent survey on the use of martingale methods 
for establishing heavy-traffic limits of multi-server queues with exponentially dis- 
tributed service times). Indeed, we believe that the framework developed here can 
be extended in many ways, for example, to include abandonments. The characteri- 
sation of the pre-limit obtained here is also used to establish central limit theorems 
in [15j . In the context of single-server queueing networks, recent works that have 
used measure- valued processes to study fluid limits include [4] , [5] , [8] , [9] and [10] . 

The outline of the paper is as follows. A precise mathematical description of the 
model, including the basic assumptions, is provided in Section Section [3] intro- 
duces the fluid equations and contains a summary of the main results. Uniqueness 
of solutions to the fluid equations is established in Section [4] and the functional 
strong law of large numbers limit is proved in Section [5] Finally, the large-time or 
equilibrium behavior of the fluid limit is described in Section [6l In the remainder 
of this section, we introduce some common notation used in the paper. 

1.2. Notation and Terminology. The following notation will be used throughout 
the paper. Z + is the set of non-negative integers, R is set of real numbers and R + 
the set of non-negative real numbers. For a, b £ R, a V b denotes the maximum of 
a and b, a A b the minimum of a and b and the short-hand a + is used for a V 0. 
Given A C R and a £ R, A — a equals the set {x £ R : x + a £ A} and TLb denotes 
the indicator function of the set B (that is, ls(a;) = 1 if x £ B and lis (a;) = 
otherwise). 

1.2.1. Function and Measure Spaces. Given any metric space E, Cb(E) and C C (E) 
are the space of bounded, continuous functions and, respectively, the space of con- 
tinuous real- valued functions with compact support defined on E, while C 1 (£') is 
the space of real- valued, once continuously differentiable functions on E, and C^(E) 
is the subspace of functions in C 1 (i5) that have compact support. The subspace of 
functions in C 1 (i?) that, together with their first derivatives, are bounded, will be 
denoted by Cl(E). For M < oo, let £}{[Q,M)) and £ x oc ([0, M)) represent, respec- 
tively, the spaces of integrable and locally integrable functions on [0, M), where for 
M < oo a locally integrable function / on [0, M) satisfies Jj , f(x)dx < oo for all 
a < M . The constant functions / = 1 and / = will be represented by the symbols 
1 and 0, respectively. Given any cadlag, real-valued function if defined on E, we 
define ||<p|| T = sup se[0 T] \<p(s)\ for every T < oo, and let H^H^ = sup se[0 \<p(s)\, 
which could possibly take the value oo. In addition, the support of a function ip is 
denoted by supp(y). 
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The space of Radon measures on a metric space E, endowed with the Borel a- 
algebra, is denoted by M{E), while Mf(E), Mi(E) and M<i(E) are respectively, 
the subspaces of finite, probability and sub-probability measures in AA(E). Also, 
given B < oo, A4<b(E) C Mf{E) denotes the space of measures /x in A4f(E) such 
that \n(E)\ < B. Recall that a Radon measure is one that assigns finite measure 
to every relatively compact subset of R+ . The space M. (E) is equipped with the 
vague topology, i.e., a sequence of measures {fJ. n } in M.(E) is said to converge to \x 
in the vague topology (denoted fi n —> fi) if and only if for every ip G C C (E), 

(1.1) / p(x) fi n (dx) — > / (f(x) fi(dx) as n — ► oo. 

J E J E 

By identifying a Radon measure /i G Ai(E) with the mapping on C C (E) defined by 

p i ► / p{x) fJ,(dx), 

J E 

one can equivalently define a Radon measure on £ as a linear mapping from C C (E) 
into R such that for every compact K. C E, there exists < oo such that 

< Lie IMI^ VV € C C (E) with supp((,o) C IC. 

On A4f(E), we will also consider the weak topology, i.e., a sequence {/i n } in M.p{E) 
is said to converge weakly to [i (denoted fi n — > L>) if and only if (jl.ip holds for every 
95 G Cb(E). As is well-known, A^(-E) and A4p(E), endowed with the vague and 
weak topologies, respectively, are Polish spaces. The symbol S x will be used to 
denote the measure with unit mass at the point x and, by some abuse of notation, 
we will use to denote the identically zero Radon measure on E. When E is an 
interval, say [0, M), for notational conciseness, we will often write -M[0, M) instead 
ofX([0,M)). 

We will mostly be interested in the case when E — [0, M) and E — [0, M) x R + , 
for some M G (0, 00]. To distinguish these cases, we will usually use / to denote 
generic functions on [0, M) and <p to denote generic functions on [0,M) x R + . By 
some abuse of notation, given / on [0, M), we will sometimes also treat it as a 
function on [0, M) x R + that is constant in the second variable. For any Borel 
measurable function / : [0, M) — > M that is integrable with respect to £ G A4 [0, M), 
we often use the short-hand notation 

</,0= / f(x)Z(dx). 

J[0,M) 

Also, for ease of notation, given £ G -M[0, M) and an interval (a, 6) C [0,M), we 
will use f(a, b) and £(a) to denote £((a, b)) and £({a}), respectively. 

1.2.2. Measure-valued Stochastic Processes. Given a Polish space TL, we denote 
by X>-h[0,T] (respectively, X'-^[0,oo)) the space of W-valued, cadlag functions on 
[0, T] (respectively, [0, 00)), and we endow this space with the usual Skorokhod J\- 
topology [TS]. Then T>t-c[0, T] and T>t-c[0, 00) are also Polish spaces (see [IB])- In this 
work, we will be interested in TC- valued stochastic processes, where H = A4f[0, M) 
for some M < 00 . These are random elements that are defined on a probability 
space (fl,^ 7 , P) and take values in 2?^[0, 00), equipped with the Borel er-algebra 
(generated by open sets under the Skorokhod Ji-topology). A sequence {X n } of 
cadlag, H-valued processes, with X n defined on the probability space (fi n , T n , P„), 




ip{x) fj,(dx) 
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is said to converge in distribution to a cadlag H-valued process X defined on 
(f2, T 1 P) if, for every bounded, continuous functional F : T>n[0, oo) — > E, we have 

lim E„ [F(X n )] =E[F(X)], 

n — >oo 

where E„ and E are the expectation operators with respect to the probability 
measures P„ and P, respectively. Convergence in distribution of X n to X will be 
denoted by X n X. 

2. Model Dynamics and Basic Assumptions 

In Section [2. II we describe our basic model and state our main assumptions, and 
in Section 12.21 we introduce some auxiliary processes that are useful for the study 
of the dynamics of the model. 

2.1. Description of the Model. Consider a system with N servers, where arriv- 
ing customers are served in a non-idling, First-Come-First-Serve (FCFS) manner, 
i.e., a newly arriving customer immediately enters service if there are any idle 
servers, or, if all servers are busy, then the customer joins the back of the queue, 
and the customer at the head of the queue (if one is present) enters service as soon 
as a server becomes free. Our results are not sensitive to the exact mechanism 
used to assign an arriving customer to an idle server, as long as the non-idling 
condition is satisfied (see Remark IA.2[) . Let denote the cumulative arrival 

process, with E^ N \t) representing the total number of customers that arrive into 
the system in the time interval [0, t], and let the service requirements be given by 
the i.i.d. sequence {vi, i = —N + 1, — N + 2, . . . , 0, 1, . . .}, with common cumulative 
distribution function G. For i £ N, Vi represents the service requirement of the zth 
customer to enter service after time 0, while {vi, i = —N + 1, . . . , 0} represents the 
service requirements of customers already in service at time (if such customers 
are present), ordered according to their arrival times (prior to zero). When E^ N ' 
is a renewal process, this is simply a GI/G/N queueuing system. 
Consider the process R^ defined, for s > 0, by 

(2.1) R { e \s) = inf{* > : #(s +t)> E^ N \s)}. 

Note that by our assumption on the finiteness of E^ N \t) for t finite, Rg(s) > 
for s > 0. The following mild assumptions will be imposed throughout, without 
explicit mention. 

• The cumulative arrival process E^ N ' is independent of the sequence of ser- 
vice requirements {vj,j = — N + 1, . . . , }; 

• The process R^ is Markovian with respect to its own natural filtration 
(this holds, for example, when E^ N > is a renewal process or an inhomogc- 
neous Poisson process); 

• G has density g. 

• Without loss of generality, we can (and will) assume that the mean service 
requirement is 1: 



(2.2) 



' (1 — G(x)) dx = xg{x) dx = 1. 

[0,oo) •Ao.oo) 
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The first two assumptions above are very general, allowing for a large class 
of arrival processes. Note that the third assumption implies, in particular, that 
G(0+) = 0. The existence of a density is assumed for convenience, and is satisfied 
by a large class of distributions of interest in applications. The relaxation of this 
assumption would lead to a more complicated and somewhat less intuitive repre- 
sentation for the fluid limit and thus, for ease of exposition, we have restricted 
ourselves to this generality. Define the hazard rate 

(2.3) h{x) = ^L_ for*G[0,M), 

where M = sup{x G [0, oo) : G(x) < 1}. Observe that h is automatically locally 
integrable on [0, M) since for every < a < b < M, 




h{x) dx = ln(l - G{a)) - ln(l - G(b)) < oo. 



When additional assumptions on h are needed, they will be mentioned explicitly in 
the statements of the results. 

The A-server model described above can be represented in many ways (see, for 
example, representations for GI/G/N queueing systems in [TJ Chapter XII]). For our 
purposes, we will find it convenient to encode the state of the system in the processes 
(R^\ X^ N \ u^ N ^), where R^ is the residual inter-arrival time process defined in 
(12. ip . X( N \t) represents the number of customers in the system at time t (including 
those in service and those in the queue, waiting to enter service) and u^ N '(t) is the 
discrete non-negative Borel measure on [0, M) that has a unit mass at the age of 
each of the customers in service at time t. Here, the age Oj of customer j is (for 
every realisation) the piecewise linear function on [0, oo) that is defined to be till 
the customer enters service, then increases linearly while the customer is in service 
(representing the amount of time elapsed since entering service) and is then constant 
(equal to the total service requirement) after the customer departs. Hence, the total 
number of customers in service at time t is given by (1, v\ ) = v\ ([0, M)), which 
is bounded above by N and so G Af f([0, M)) for every t G [0, oo). Our results 
will be independent of the particular rule used to assign customers to stations, but 
for technical purposes we will find it convenient to also introduce the additional 
"station process" sW = {s^ N \j G {-A + 1, . . . , 0} U N). For each t G [0, oo), if 

customer j has already entered service by time t, then s^ N ^ (t) is equal to the index 
i G {1,...,N} of the station at which customer j receives/received service and 
s^ N \t) = otherwise. Finally, for t G [0, oo), let J-[ N ^ be the c-algbera generated 

by {R { g\s),af\{s),sf\s),j G {-N + 1,. . . ,0} U N, s G [0,t]} and let {^ N) } 
denote the associated completed, right-continuous filtration. As elaborated in the 
next section, it is not hard to see that (£W,XW,^)) is T\ ^-adapted (also see 
Appendix [X] for an explicit construction of these processes that shows, in particular, 
that they are well-defined). In fact, although we do not prove or use this property 
in this paper, it is not hard to show that {(R^\t), X^ N \t), v[ ), {f^'}} is a 
Markov process. 



2.2. Some auxiliary processes. We now introduce the following auxiliary pro- 
cesses that will be useful for the study of the evolution of the system: 
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• the cumulative departure process D^ N \ where D^ N \t) is the cumulative 
number of customers that have departed the system in the interval [0,t]; 

• the process K^ N \ where K^ N ^{t) represents the cumulative number of cus- 
tomers that have entered service in the interval [0,t]; 

• the age process (dj N \j = — i/q N \m. + ) + 1, . . . , 0, 1, . . .) where a^ N \t) is 
the time that has elapsed since the jth customer entered service, with the 
convention that aj(t) is set to zero if customer j has not yet entered 
service by time t and remains constant once the customer departs; 

• the idle servers process I^ N \ where I^ N \t) is the number of idle servers at 
time t. 

Simple mass balances show that 

(2.4) £>W =X«(0)-I< N »l#) 
and 

(2.5) = (1, v™) - (1, i/W) + DW. 

Due to the FCFS nature of the service, observe that K^ N \t) is also the highest 
index of any customer that has entered service. The age process of all customers in 
service increases linearly and so, given the service requirements of customers, the 
evolution of the age process can be described explicitly as follows: for j < K^ N \t), 

W, tl = ( af\s)+t-8 i{af\t)< Vj , 



(2.6) a?>(t) 



Vj otherwise, 



and a,j '(t) = for all j > K^ N \t). The measure can be written in the form 

if< N >(t) 

(2-7) v[ N) V S (iv),.l, (« w v 

V ' t ^ a.) (*) {a.) (t)<Vj} 

Here S x represents the Dirac mass at the point x. Now, at any time t, the age 
process of any customer has a right-derivative that is positive (and equal to one) 
if and only if the customer is in service, and has a left-derivative that is positive 
and a right-derivative that is zero if and only if it has just departed. Thus 
is clearly {t[ ^j-adapted and, since can be written explicitly in terms of the 
age process as 

K<"'(t) 

(2.8) y s a 



|-3i-(*+)>o| 



i/W is also {Ft ^'j-adapted. Furthermore, since (\,v\ N ^) represents the number 
of customers in service at time t, the idle servers process is given explicitly by the 
relation 

(2.9) /W=JV-(l,i/W). 
The non-idling condition then takes the form 

(2.10) /W = [iV-XW]+. 

Indeed, note that this shows that when X (N 1(t) < N, so that > 0, the 

number in system is equal to the number in service, and so there is no queue, while 



s 
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if XW(t) > N, so that there is a positive queue, I^ N '(t) = 0, indicating that there 
are no idle servers. ^From the above discussion, it follows immediately that the 
processes iW, i/W, Z>W, ifW and /W are all {.F t (JV) }-adapted. For an explicit 
construction of these processes, see Appendix [Al and, in particular, Remark I A. II 

Remark 2.1. If M < oo, then for every N, we will always assume that Uq N ^ has 
support in [0, M). From (|2.7p . this automatically implies that i/ t also has support 
in [0, M) for every t £ [0, oo) and, moreover, that v^ N > g £>a4<i[o,m) [0, co). 

3. Main Results 

We now summarise our main results. First, in Section 13.11 we introduce the 
so-called fluid equations, which provide a continuous analog of the discrete model 
introduced in Section [2l In Section 13.21 we present our main results, which in 
particular show that the fluid equations uniquely characterise the strong law of 
large numbers limit of the multi-server system, as the number of servers goes to 
infinity. Lastly, in Section 13.31 we show how our results can be used to obtain fluid 
limits of various other functionals of interest. This, in particular, illustrates the 
usefulness of adopting a measure- valued representation for the state. 

3.1. Fluid Equations. Consider the following scaled versions of the basic pro- 
cesses describing the model. For N 6 N, the scaled state descriptor {R^ ,X N , V^ N ^ ) 
is given by 

(3.1) IK".;.* (.V»! T '», = —— --' ( ,m,'i = 



for t g [0, oo) and any Borel subset B of R+, and observe that v^ N \t) is a sub- 
probability measure on [0, oo) for every t £ [0,oo). Analogously, define 

[ ' } N '■ N ' N N ' 

Let 2r + [0, oo) to be the subset of non-decreasing functions / € 2?r + [0, oo) with 
/(0) = 0. Recall that M = sup{ir e [0, oo) : G(x) < 1}, and define 

(3.3) So = {{f.x.ji) e 2" K+ [0,oo) x R + x M<i[Q,M) : 1 - (1,/i) = [1 - x] + ) . 

So serves as the space of possible input data for the fluid equations. We make 
the following convergence assumptions on the primitives of the scaled sequence of 
systems. 

Assumption 1. (Initial conditions) There exists an So-valued random variable 
(E, X(0), Vo) such that, as N — > oo, the following limits hold almost surely: 

(1) E {N) -^E in £> K+ [0, oo), where V,[E(t)] < oo for all t e (0, oo); 

(2) X (N) (0) -> X(0) in R+, where E[X(0)] < oo 

(3) V { Q N) -^vo inM<x[0,M). 

Remark 3.1. By the (generalized) dominated convergence theorem, conditions (1) 

and (2) of Assumption [T] imply that the convergence of E {N) to E and of X {N) (0) to 
X(0) also holds in expectation, so that in particular, we have for every t € [0, oo), 

for all sufficiently large N, E[X (N) (0) + E (N) (t)] < oo. 
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Remark 3.2. If the limits in Assumption [T] hold only in distribution rather than 
almost surely, then using the Skorokhod representation theorem in the standard 
way, it can be shown that all the stochastic process convergence results in the 
paper continue to hold. 

Our goal is to identify the limit in distribution of the quantities (X^ N ,V^), 
as N — > oo. In this section, we first introduce the so-called fluid equations and 
provide some intuition as to why the limit of any sequence (X N ,V^ N ^) should be 
expected to be a solution to these equations. In Section [5l we provide a rigorous 
proof of this fact. 

Definition 3.3. (Fluid Equations) The cadlag function (X, v) defined on [0, oo) 
and taking values in R + x A4<i[0, M) is said to solve the fluid equations associated 
with {E,~X(Q),Vq) G S and h 6 Cj oc [0, M) if and only if for every t e [0, oo), 

(3.4) f (h,V s ) ds < oo, 

Jo 

and the following relations are satisfied: for every (p <E C*([0, M) x 1R+), 

(3.5) (tp(-,t),V t ) = (<?(•, 0), F ) + / {tp s (-,s),V s )ds+ (ip x (-,s),V s )ds 

Jo Jo 

(h{-)tp(;s),V s )ds+ / ip(0,s)dK(s), 
io Jo 

(3.6) X(t) = X(0)+E(t)- [ (h,V s )ds 

Jo 

and 

(3.7) l-(l,V t ) = [l-X(t)}+, 
where 

(3.8) K(t) = (l,F t )-(l,F )+ / {h,V s )ds. 

Jo 

We now provide an informal, intuitive explanation for the form of the fluid equa- 
tions. Suppose (X, 77) solves the fluid equations associated with some (E,X,Vo) £ 
Sq. Then, roughly speaking, for x € R+, V s {dx) represents the amount of mass 
(or limiting fraction of customers) whose age lies in the range [x, x + dx) at time 
s. Since h is the hazard rate, h(x) represents the fraction of mass with age x that 
would depart from the system at any time. Thus (h,V s ) represents the departure 
rate of mass from the fluid system at time s, and the process D that satisfies 

(3.9) D(t) = [ {h,V s )ds fort £[0,00) 

Jo 

represents the cumulative amount of departures from the fluid system. Since E is 
the limiting cumulative arrival rate of mass into the fluid system in the interval 
[0,t], a simple mass balance yields the relation ()3.6() (in analogy with the pre-limit 
equation (|2.4p ). Likewise, (|3.7p and (|3.8|) are the fluid versions of the non-idling 
condition (|2.10|) and the mass balance relation (|2.5| . respectively. 
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Next, note that the fluid equation (|3.5p implies, in particular, that for f G 

el[o,M), 

(3.10) (f,v t ) = (f,V )+ f (f',V s )ds- f (fh,V s )ds + f(0)K(t). 

Jq Jo 

The difference (/, V t ) — (/, Vq) is caused by three different phenomena - evolution 
of the mass in the system, departures and arrivals - which are represented by the 
last three terms on the right-hand side of (|3.10[) . Specifically, the second term on 
the right-hand side represents the change in V on account of the fact that the ages 
of all customers in service increase at a constant rate 1, the third term represents 
the change due to departures of customers in service, and the last term on the 
right-hand side of (|3.10[) accounts for new customers entering service. Here K(t) 
represents the cumulative amount of mass that has entered service in the fluid 
system, and is multiplied by / (0) because any arriving customer by definition has 
age at the time of entry. 

3.2. Summary of Main Results. Our first result concerns uniqueness of solu- 
tions to the fluid equations, which is established at the end of Section 14.11 

Theorem 3.4. Given any (E, X(0), v$) G So and h G C[0, M), there exists at 
most one solution {X,v) to the associated fluid equations Jff.^| j- JX"7[ ). Moreover, 
the solution (X,V) satisfies, for every f G Cb(R_|_) 7 
(3.11) 

f f(x)V t (dx)= [ f(x+t) 1 ~ G % + % (dx)+ [ f(t-s)(l-G(t-s))dK(s), 

J[0,M) J[0,M) 1 - Lr ( x ) JO 

where K is given by the relation 13.8\) . Moreover, if E is absolutely continuous with 
X = dE/dt, then K is also absolutely continuous and~K = dK/dt satisfies for a.e. 

t e [0, oo), 

r _ \(t) if lot) < i 

(3.12) «(*)=< X(t)A(h,V t ) i/£(t) = l 

[ (h,V t ) ifX(t)>l. 

Furthermore, ifvo and E are absolutely continuous, then V s is absolutely continuous 
for every s € [0, oo). 

It is also possible to consider the case when the residual service times of the 
customers already in system is distributed according to another distribution G. 
Indeed, our proofs show that in this case the relations (|3 . 1 1 [) and (|3.12[) continue 
to hold, with G in the first integral on the right-hand side of (|3. 1 1|) replaced by 
G. The uniqueness result can, in fact, be shown to hold for any h G >C; 1 OC [0, M) for 
which (|3.4[) holds (see Remark l4.12[) , but we defer the proof of this to a subsequent 
paper. 

Our next main result shows that a solution to the fluid equations exists and 
provides an explicit characterisation of the functional law of large numbers limit of 
the A^-server system, as N — > oo. 

Theorem 3.5. Suppose Assumption^ is satisfied for some {E,X{Q),vq) G <So- 
Then the sequence {(X ji? )} is relatively compact. Moreover, if h is continu- 
ous on [0, M) then as N oo, (X N converges in distribution to the unique 
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solution (X, v) of the associated fluid equations. On the other hand, if E and i/q 
are absolutely continuous, and the set of discontinuities of h in [0, M) is closed and 

has zero Lebesgue measure, then every limit point (X,T>) of {(X^ ,^ N ^)} satisfies 
the fluid equations. 

The proof of the theorem is given at the end of Section 15.41 The key steps in the 
proof involve showing tightness of the sequence {(X^ N \l' i - N ))}, which is carried 
out in Section [5731 characterising the limit points of the sequence, which is done in 
Section l5.4| and establishing uniqueness of solutions to the fluid equations, which 
is the subject of Section |4] 

The last main result describes the long-time behaviour of the unique solution 
(X,~is) to the fluid equations in the time-homogeneous setting. Define V* to be the 
measure on [0, M) that is absolutely continuous with respect to Lebesgue measure, 
and has density 1 — G(x): for any Borel set A C [0,M), 

(3.13) V*(A) = I (1- G{x))dx. 

J A 

Theorem 3.6. Given h £ Cj oc [0, M), A e (0, oo) and (A1,X(0),F ) € So, suppose 
there exists a unique solution (X,V) to the associated fluid equations. Then the 
following two properties are satisfied. 

(1) If X(0) = then as t — > oo, X(t) = (l,^t) converges monotonically up to 1 
and, if in addition A < 1, then for every non-negative function f £ Cb[0, M), 
(/, V t ) converges monotonically up to X(f, F*). 

(2) Suppose the density g of the service distribution is directly Riemann in- 
tegrable and A > 1. Then, given any (Al, X(Q),Vq) G iSo, for any f £ 
C b [0,M) 

(3.14) Um(f,V t ) = (f,V m )= f f(x)(l-G(x))dx. 
In other words, Vt converges weakly to as t — > oo. 

A precise definition of direct Riemann integrability can be found in [TJ p. 154]. It 
is satisfied by most distributions of interest. The proof of Theorem l3.6l is presented 
in Section[BJ For the case A < 1, property (1) of Theorem l3.6l was stated as Theorem 
7.3 of [21] without proof. 

Remark 3.7. Our main theorems hold for the majority of distributions that arise 
in practice, including the exponential, lognormal, phase type and uniform distri- 
butions and, when vq and E are absolutely continuous, the Weibull and Pareto 
distributions. It does not, however, cover the deterministic distribution. 

3.3. Fluid Limits of Other Functionals. In the last section, we identified the 
fluid limit of the scaled number of customers in system. In fact, the fluid limit 
contains a lot more information. For instance, as a direct consequence of the con- 
tinuous mapping theorem, Theorem 13.51 also identifies the limit, as N — > oo, of the 

scaled queue length process = Z^/N, which is the normalised number of 

customers waiting in queue (and not in service) at any time: we have 

Z {N) ^E {N) -K (N) ^Z^E-K. 



Below, we identify the fluid limits of other functionals of interest. 
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3.3.1. Waiting and Sojourn Time. The waiting time functional is of particular in- 
terest in the context of call centers, where service targets are often specified in 
terms of the proportion of calls that experience a wait of less than some given level 
(see, for example, [2]). 

Given a non-decreasing / S 2?[0, oo) with Lf = sup se r 0jOO ) f(s), consider the 
following inverse functionals that take values in the extended reals: 

(3.15) inv[/](t) = inf {s > : f(s) > t} 

for t S [0, Lf], with the convention that [0, Lf] = [0, oo) if Lf — oo, and if Lf < oo 
then inv[/](£) = oo for t > Lf. Likewise, let 

(3.16) / -1 (f)= sup {«><>:/(«)<*} 

for t G [0, Lf) and / _1 (£) = oo for t > Lf. The waiting time (respectively, 

the sojourn time uj ) of the jth customer in the iVth system is defined to be the 
time elapsed between arrival into the system and entry into service (respectively, 
departure from the system). These functionals can be written explicitly as 

(3.17) w {N) (j) = mv[K iN) ](j) - inv[£ (JV) ](j) 
and 

(3.18) v {N \j) = mv[D^](j) - mv[E^](j) 

for j G [0, L E {n)]. Also, consider the related processes defined on [0, oo) by 

5?W(t) = w^){E^ N \t)) and »W = v^{E^ N \t)) 
and note that for t G [0, oo), 

5?W(t) = inv[ir W ](E W (£)) - inv[E W ](E (Ar) (t)) 

and similarly, 

^) = inv[U (JV) ](S (Ar) (t)) - inv[S (Ar) ](S (Ar) (£)). 
Lastly, let w and respectively, be the processes given by 

(3.19) w{t) = K^ (E(t)) - t and v(t) = D^ (E(t)) - t 

for t G [0, oo). We will say a function / G T>[0, oo) is uniformly strictly increasing 
if it is absolutely continuous and there exists 9 > such that f(t) > 9 for all 
t G [0, oo). Note that for any such function f~ 1 {f{t)) = t and / _1 is continuous on 
[0, oo). We have the following fluid limit result for the waiting and sojourn times 
in the system. 

Theorem 3.8. Suppose the conditions of Theorem \ 3.5\ hold and E is uniformly 
strictly increasing. If, in addition, K is uniformly strictly increasing then => w 
as N — > oo. Likewise, if D is uniformly strictly increasing, then v^ N ^ v as 
N -> oo. 

Proof. By Assumption Q] and Theorem l3~5l it follows that E~ {N} =>■ E, ~K {N) =>■ K 
— ( N ) — 

and D =>■ D. Using the Skorokhod Representation Theorem, we can assume 
that the convergence in all three cases is almost sure. When combined with the 
fact that E, K and D are uniformly strictly increasing, Lemma 4.10 of [19] shows 
that invf/^] — > / _1 (almost surely, uniformly on compacts) for f = E,K and D. 
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Now, fix T < oo and w g fi such that these limits hold and also fix some e > 0. 
Moreover, let Nq — Nq(uj) < oo be such that for all N > Nq, 

™[f (N) }(s)-r\s) 



s6[0,B (JV) (T)] 



sup 

for / = E,K,D. Then we have 

sup 

*e[o,T] 



< £ 



sup \mv[K (N) ](E {N) (t)) -K 1 {E{t))\ 



< sup \mv[K (N) }{E {N) (t)) - K 1 (E (N) {t))\ 
te[o,T] 

+ sup \K-\E (N \t))-K-\E(t))\ 
te[o,T] 

<e+ sup {K^ 1 (E (N) {t)) -K' 1 {E(t))\. 
fe[o,T] 

The continuity of K and the fact that a.s., E N ^ — » -E u.o.c. as N oo, together, 
ensure that a.s. \K 1 {E' yN ^) — K 1 (E)\ — > u.o.c. as A" — > oo. So we have 

lim sup |inv[i? (Ar) ](E (Ar) (t)) <e. 
N ^°°te[o,T] 

Sending e — ► 0, we infer that inv [K y '} o E y ' ^ K oE uniformly on [0, T}. An 

(AT) ( TV) 

analogous argument shows that inv[_B ] o E — > t, where t : t i — > t is the identity 

mapping on [0, oo) and mv(D ] o E D 1 o E. When combined with the 

definitions of w and v, the theorem follows. □ 

^From the results in Section [HI it is easy to see that a sufficient condition for 
the assumptions of Theorem 13.81 to hold is that E be piecewise linear with slope 
strictly bounded away from zero. 

3.3.2. Workload Process. The workload (or unfinished work) process 17 W is de- 
fined to be the amount of work in the A^th system (including the work of customers 
waiting in queue and the residual service of customers in service): 

,•=-(1,^)4-1 j=KW(t)+l 
— (V) 

Let the scaled workload process U be defined in the usual fashion. We briefly 
outline below how the results and techniques of this paper may be used to charac- 

(JV) 

terize the limit U of the sequence of scaled workload processes {U }. 

Let r]( N ' be the measure- valued process (analogous to i/W) that represents the 
residual service times (rather than the ages) of customers in service in the A"th 
system: for t G [0, oo), 



and let denote the corresponding scaled quantity. Fluid equations can be 

derived for the limit rj of the sequence {rf N ^} in a manner similar to those derived 
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for v in this paper and, under mild assumptions, we believe it can be shown that, 
as N — > oo, Tj( N > =4> fj, where for every / £ C c [0, M) and t £ [0, oc), 

</,%>= / f r ^±fi-f(u)du)v t (d X ). 

J[o,M) Vo 1 - G W / 

A completely rigorous proof of this result is beyond the scope of this paper. How- 
ever, below we provide a plausible argument to justify the above claim. Given the 
age x of any customer that was already in service at time 0, the probability that 
the residual service time of the customer at time t is greater than u is given by 
(1 — G(x + t + u))/(l — G(x)). Thus the density of the residual service time distri- 
bution at time t for a customer that had age x at time is g(x + t + -)/(l — G(x)). 
Likewise, the density of the residual service distribution at time t for a customer 
that entered the system at time < s < t is g(t — s + •). Moreover, given the ages 
of all customers in service, the residual service times of customers in service are 
independent. Therefore, by a strong law of large numbers reasoning, one expects 
that the the limiting residual service measure rj can be written in terms of the 
limiting initial age measure vq and limiting cumulative entry-into-service process 
K as follows: for / £ C c [0, M), 

</,%> = / (T 9( * + *t" ) f(u)du)v (dx) 

J[0,M) \J0 1 _ G ( X > ) 



\J0 



g(t -s + u)f(u) du dK(s). 



The desired result is then obtained by using the representation (|4. 2|) to rewrite the 
right-hand side above as an integral with respect to v t . 

In turn, since the workload process admits the alternative representation 

_E< N )(t)+A< N >(0) 

C/W( i ) = (x,r ? W)+ J2 »i. 

j=K( N )(t) + l 

the convergence of to rj and the fact that the service times {vj} are i.i.d. with 
mean 1 should imply (under mild assumptions that justify the substitution of linear 

test functions /) the convergence U =>■ U as TV — > oo, where 

^ I / r- du \ Vt{dx) + m 

J[0,M) \Jo 1 - G(x) J 



4. Uniqueness of Solutions to the Fluid Equation 

In this section we show that there is at most one solution to the fluid equation 
for any given initial condition. In fact, we will establish two stronger properties of 
the the fluid equation, both of which imply uniqueness. The first is the continuity 
of the mapping that takes (E, X(Q),Vq) £ Sq to a corresponding solution (X, V) of 
the fluid equation, which is established in Section [4. II The second is a maximality 
property that is established in Section 14.21 The proofs of both continuity and 
maximality rely on identifying the solution to a certain integral equation, which is 
carried out in Section l4~3l Existence of solutions to the fluid equation will follow 
from results established in the next section (see, in particular, Theorem 15. 12|) . 
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4.1. Continuity of the Fluid Equation Map. We begin with Theorem 14. 1[ 
which identifies an implicit relation that must be satisfied by the processes V and 
K that satisfy the fluid equations. This implicit relation, along with the non-idling 
condition, is then used to establish continuity of the fluid solution in Theorem [43] 



Theorem 4.1. Given M, B £ (0,oo), h € C[0,M), z7 £ M< B [0,M) and Z £ 
2r + [0,oo), suppose v £ £>A4< B [o,Af)[0 ; oo) satisfies for every ip £ C^([0,M) x M + ) 
and t £ [0, oo), 

((p(-,t),V t ) = {(p(;0),V o ) + / (ip s (-,s),V s )ds+ (ip x (-,s),V s )ds 
(4.1) rt ^ t ^ 

(/i(>(-,s),I7 s }ds+ / ^(0,*)dZ(s). 
o Jo 

T/ien /or every f 6 Cfc(K + ), F satisfies 
(4.2) 

f(x)v t (dx)= [ f(x+t) 1 ~ G %\ t K (dx)+ [ f(t-s)(l-G(t-s))dZ(s) 

[0,M) J[0,M) L — Lr[X) J 

for all t £ [0, oo). 

The integral equation (|4.ip is simply the fluid equation (|3 . 5[) . with K replaced 
by an arbitrary, non-decreasing, cadlag function Z. Also, (|4.2|) only depends on 
the values of / in [0, M) since f(u)(l - G(u)) = for all u > M. Moreover, (O 
explicitly characterises the deterministic measure- valued process v. Theorem 14.11 
and consequently the continuity result, can be shown to hold more generally for 
h G £j oc [0,M) for which (|3.4|) is satisfied (see Remark l4.12p . but this extension is 
omitted from this paper in the interest of simplicity of exposition. 



Remark 4.2. The last integral in (14. 2|) is, as usual, to be interpreted as a Riemann- 
Stieltjes integral. A straightforward integration-by-parts shows that for every / G 
C^(M+) and t £ [0, oo), this integral also admits the alternative representation 



f(t-s)(l-G(t-s))dZ(s) 

i4.;]) =/(0)Z(t)+ [ f'(t-s)(l-G(t-s))Z(s)ds 

Jo 

f(t-s)g(t-s)Z{s)ds. 



The proof of Theorem 14.11 involves PDE techniques and is relegated to Section 
4.31 As a simple corollary of Theorem 14. 11 we have the following result. 



Corollary 4.3. Let (X, 77) be a solution to the fluid equations associated with 
(E, X(0),Vq) £ So and h that is continuous on [0, M) . Then the function K defined 
by VS. 8\) satisfies the implicit equation 

TrU\ /- - N f G(x + t)-G{x)_ , 

K(t) = (1, i/ t> ) - <1, i/o) + / ' , v Q (dx) 



[0,M) 



(4.4) t 

+ I g(t- s)K(s)ds 

for every t £ [0, oo). 



1 - G(x) 



i) 
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Proof. We first claim that if (X, V) solve the fluid equations, then K defined by 
must necessarily be non-decreasing (as one would expect from the interpretation of 
K as the limiting fraction of cumulative entries into service). In order to justify 
the claim, fix < s < t. If X(t) > 1 then the non-idling condition (|3 . T|) implies 
that Cl,Vt) = 1 which, when substituted into (13.811 . shows that 



K(t) -K(s) = 1 - (l,V a ) + / {h,V s )ds> / (h,V s )ds>0. 

J s J s 

On the other hand, if X(t) < 1 then the non-idling condition (13. 7|) shows that 
(l,z/ t ) = X(t) and (1,V 8 ) < X(s). Hence (|3~8)) . together with (|3~6)) and the fact 
that E is non-decreasing, shows that 

K{t)-K{s) = (l,V t )-X(t) - (1,V S ) +X(s) +E{t) -E{s) > 0, 

which proves the claim. 

In addition, by assumption, K and V satisfy (|3.5[) and so Theorem 14. II applies, 
with Z = K. Substituting / = 1 £ C^(M+) and Z = K in l[4T2) . we obtain the 
relation 

(l-G(t-s))dK(s) = (l,V t )- [ 1 ~ G( -* + . t) v (dx) 



l[0,M) 1 ~G(x) 
= (Mt) - (Mo) + / : 7^ i/o (da;). 

J[0,M) L — U{X) 

On the other hand, equation (|4.3[) with Z ~ K and / = 1 shows that 
t ^.t 
(1 - G(t - a)) cO? (s) = F(t) - / g(t- s)K(s) ds. 

Jo 

Equating the right-hand sides of the last two displays, we obtain (|4.4|) . □ 



As an immediate consequence of Theorem 14.11 and Corollary |4.31 we obtain the 
following simple bound. Given fj, £ Mp[0, M), here \fj,\ is used to denote the total 
variation measure associated with /i and /i|rv represents the total variation of /x 
on [0,M). 

Lemma 4.4. For i = 1,2, suppose Vq £ M<i[0,M) and Z (l) £ I R+ [0, oo) are 

given, and suppose i/W £ T>m<i[0,m) satisfies 113. 1 0\) with K replaced by Z % \ 
Then for every T < oo and f £ Cj(K+), 

(4-5) ||(/,T7( 2 )) - (/,F«)|| t < H/IL |AF | Ty + (2 ||/|| T + ||/'|| T ) ||AZ|| T , 

U A 7 • J A- ' -( 2 ) ~W 

where AZ = Z — Z ana Avo = i/ Q — i/q . 

Proo/. The relations (|4.2|) and (|4.3|l together imply that for / £ C^(R+) and t £ 
[0,00), 

{f,vf ) )~{f^ ) ) = { f(x + t) 1 ~ G{ * + t) AV (dx) + /(O)AZ(t) 
J[o,j\/) 1 ~ G(a;) 



+ / /'(t-s)(l-G!(*-s))AZ(a)ds 
f(t - s)g(t - s)AZ(s) ds. 



o 
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This implies that for / 6 C h 1 (R+) and for every t G [0, T] 

{f,vf ) )-{f,V^) 
from which (14.51) follows 



/ |/(x + i)||A77 |(dx) + (1/(0)1 + ||/|| t +||/ / y||AZ|| T 

[0,oo) 

□ 



We now state the main result of this section. Below, AH denotes H^> — H^ 
for H = K,D,E,X and V. 

Theorem 4.5. (Continuity of Solution Map) Suppose h is continuous on 
[0, M), and for i = 1,2, let (X oe i/ie solution to the fluid equations as- 

sociated with (E^ \ x^ ^ (0), Vq^) € iSo and Zet "* and D*" ' be defined as in H3.8\) 
and VS. 9\) , respectively, withv replaced byv^\ Ifv^ = then for every T < oo, 

A\X(0)\ + sup AE(t) v 
te[o,T] 

and hence 

(4.7) ll A #|| T v II a;d IIt ^ l AX (°)l + II a ^IIt • 

Moreover, for every T < oo and / g C^J(R+) 7 













(4.6) 


sup AJf(f) 


V 


sup AD(t) 


< 




te[o,T] 




f£[0,T] 





(4.8) 



(/,77( 2 )) - </,77«) < (2 ||/|| T + ||/'|| T ) (A1(0) + ||A£|L) . 



Proo/. For i= 1,2, fix (#U <!) (0),Ff ) G 5 and (X W ,!?<*), Jf W ,D (i) ) as in the 
statement of the theorem. Fix T < oo and define e > by 



(4.9) 



AX(0) + sup AE(t) 

te[o,T] 



V0. 



Choose S > and define t = t$ = inf{t > : AK(t) > e + <5}. The right-continuity 
of K and K then imply that 



(4.10) 



AK(t) >e + S. 



We now show that r > T. Indeed, suppose r S [0, T] and consider the following 



two cases. 

Case 1. X (r) < 1. In this case, the non-idling condition (|3.7| implies that 

X W (r) - (1,X7W) = < X (2) (r) - (1,4 2 )). 

Together with relations (|3.8[) . (|3.6p , (|4.9[) and the fact that A77 = 0, this implies 
that 

AK(t) = AE(t) + AX(0) - (1, A77 ) - AX(t) + (1, Az7 T ) < e, 
which contradicts (|4.10p . 

Case 2. X^ 1 (r) > 1. In this case, due to the non-idling condition (|3.7j) . we have 



I.Ft 5 ) = 1 > (l,^ j )- Along with Corollary [431 and the fact that Av = 0, this 



J2) 
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implies that 



AM r ! = il. A77 r ~ .J.. AT 7 ,,; - / ^ + t) ^ Az7 (dx) 

[0,M) 1 — Lx{XJ 



g(r - s)AiC(s) ds 
= (l,A77 r )+ / g( T - s)AK(s) ds 

r - 

< / g(r - s)AK(s) ds. 



Jo 

We now assert that the right-hand side is strictly less than e + 8, which contradicts 
(|4.10p . To see why the assertion holds, note that if g(s) = for a.e. s £ [0, r], then 
the right-hand side of the last inequality equals zero, which is trivially strictly less 
than e + S. On the other hand, if g(s) > for a set of positive Lebesgue measure 
in [0, t], then the fact that AK(s) < e + S for all s £ [0, r) shows once again that 

AK{t) < [ g( T - s)AK(s) ds<(e + 8)G(r) < (e + 5). 
Jo 

In both cases we arrive at a contradiction, and therefore it must be that r > T, 
which means that AK(t) < e + 8 for every t £ [0, T\. Sending 6 J, 0, we conclude 
that AK{t) < e for t £ [0, T], as desired. In turn, using the relations (|3.8|) , (|3.9|) 
and Corollary 14.31 along with the fact that Avq = and g is non-negative, we 
obtain for every t £ [0, T], 

AD(t) = AK(t) - (1, Av t ) = f g(t- s)AK(s) ds < eG(t) < e. 

Jo 

This completes the proof of (|4.6p . and relation (|4.7[) follows by symmetry. Lastly, 

since for i — 1, 2, 77^ and X % satisfy the fluid equations (by assumption), inequal- 
ity ()4.8|) is a direct consequence of Lemma 14.41 and inequality (|4.7jl . □ 

Proof of Theorem [3741 Let (X (1) ,77 (1) ) and (X (2) ,77 (2) ) be two solutions to the 
fluid equations corresponding to (E, X(0),Uq) £ So. Fix a £ [0, oo) and choose 
a sequence of functions /„ £ C^(K+), n £ N, such that /" f l[o. a ] pointwise as 
n — > oo. Then for every t £ [0, oo) and n £ N, {f n ,V^p) = (/„,f| 2 ^) due to 
relation (|4.8p . Sending n — > oo and invoking the monotone convergence theorem, 
we conclude that F^dO, a)) = T>i' ([0, a)). Since a and t are arbitrary, it follows 

that 77(1) = p<2) and hence, by 13 . 6[) . that X = X , thus establishing uniqueness. 
The representation (|3.11|) follows immediately from Theorem 14. II 

Now, if E is absolutely continuous, then ()3.6|1 immediately shows that X is also 
absolutely continuous. In turn, using (|3.7p . (|3.8j) and the fact that |[1 — a] + — [1 — 
b} + \ < it is easy to see that K is also absolutely continuous. If X(t) < 1, then 

the non-idling condition (|3.7[) and the continuity of X show that (1,V S ) = X(s) for 
all s in a neighbourhood of t. When combined with (|3.6[) and (|3.8[) , this shows that 
7t(t) = A(t). On the other hand, if X(t) > 1, then (|3.71> and the continuity of X 
show that (1,F S ) = 1 for s in a neighbourhood of t. When substituted into (|3.8p 
this shows that 7t(t) = (h,Vt). Lastly, since X and (1, F) are absolutely continuous, 
dX(t)/dt = d(l,Vt)/dt = for a.e. i on which X(t) = (l,T7 t } = 1 (see, for example, 
Theorem A. 6. 3 of [6]). When combined with (|3.6p and (|3.8p this shows that for 
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a.e. t 6 [0,oo) such that X(t) — 1, we have 7t(£) = X(t) = {h,V t ) = X(t) A (h,V t ), 
which proves (|3.12p . Finally, since K is absolutely continuous, if T7 is also abso- 
lutely continuous then the representation p. lip immediately guarantees that V s is 
absolutely continuous for every s € [0, 00). □ 

To close the section, we state a simple consequence of uniqueness of the fluid 
limit that will be used in Section [6l For this, we require the following notation: for 

any t £ [0, 00), 

E? = E(t + •) -E(t) K* = K{t+-)-K(t) X t = X(t + -) V t =V t+ .. 

Lemma 4.6. Fix h € £^[0, M ) for which there exists a unique solution to the fluid 
equation associated with a given initial condition (E,X(0),vo) G So and h, and let 
K be the associated process that satisfies h3. 8\) . Then for any t £ [0, oo), {X ,77*) is 
a solution to the fluid equation associated with the initial condition (E ,X (0),77q) £ 
So, and is the corresponding process that satisfies \S.8\) , with 77 replaced by V 1 . 

The proof of the lemma is elementary, involving just a rewriting of the fluid equa- 
tions, and is thus omitted. 

4.2. A Maximality Property of the Fluid Solution. In this section we es- 
tablish a result of independent interest. This result is not used in the rest of the 
paper, and can thus be safely skipped without loss of continuity. Specifically, we 
show that the non-idling property (|3.7| implies a certain maximality property for 
solutions to the fluid equations. In particular, this result provides an alternative 
proof of uniqueness of solutions to the fluid limit that is different from the one using 
continuity of the solution map given in the last section. 

Fix h that is continuous on [0, M) and (E, X(0), 77o) £ So. Suppose that (X,T7) 
solve the corresponding fluid equations (|3.5|) — (|3.7|) . and let K and D be the associ- 
ated processes, as defined in Q3.8P and (13. 9| . respectively. Also, let (X ,77') be any 
process taking values in R + x A^<i[0, M) that satisfy the fluid equations, (|3.5p and 
(|3.6p . and the relation 

(4.11) (l,7/ t ) <lt(t) for t 6 [0,oo). 

Here, X and 77', respectively, represent the total number of (fluid) customers in 
system and the distribution of ages of (fluid) customers in service under any given 
feasible assignment of customers to servers that does not necessarily satisfy the 
non-idling condition (|3.7p . For t € [0,oo), let K (t) and D (t), respectively, be the 
corresponding processes representing the cumulative entry into service and cumu- 
lative departures from the system, as defined by the right-hand sides of (|3.8p and 
(|3.9p , respectively, but with 77 replaced by 77'. Then we have the following intuitive 
result that shows that the non-idling condition (|3.7p ensures that the cumulative 
entry into service and cumulative departures from the system are maximised. 

Lemma 4.7. For every t e [0, oo), K(t) > ~E' (t) and D(t) > T>'(t). 

Proof. We shall argue by contradiction to prove the lemma. Fix e > and let 

T = mi{t : K'(t) > K{t) + e}. 

Suppose T < 00. Then we consider the following two mutually exhaustive cases. 
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Case 1. Xt < 1. In this case, (|3.7p implies that Xt = (1,^t) which, along with 
(EU) and dim), shows that 

K(T) =X(0) - (1,V ) +E(T). 

On the other hand, (13. 6|) . (|3.8j) and (I4.11|) . when combined, show that for every 

t e [0,oo), 

3^(t) = (l,T7' t ) +X(0) - (l,z7 ) + E(t) < X(0) - (l,z7 ) + E(t). 

The last two equations imply that K (T) < K(T), which contradicts the definition 
of T. 

Case 2. Xt > 1. In this case, (|3.7|) shows that (1,Vt) = 1. Since the pair 77 and 
if, as well as the pair v' and X , satisfy the fluid equation (|3.5p . Corollary 14.31 and 
([3T8]) show that 

D(T) = [ (h,V s )ds 
Jo 

V {dx) + [ g{T- s)K(s)ds 
Jo 

I '-jr, Mdx) + g(T- s) (k\s) - e) d, 

[0,oo) 1 - Jo V ' 

pT 

Vo(dx) + I g(T- s)K (s) ds - eG{T) 

[0,oo 

= D'(T)~eG(T), 

from which we conclude that D (T) < D(T) +e (To be precise, the strict inequality 
above holds only if there exists a subset of [0, T] of positive Lebesgue measure, on 
which g is strictly positive - but, as in Case 2 of the proof of Theorem 14.51 it is 
easy to see that the conclusion continues to hold even when g is a.e. zero on [0, T]). 
When combined with (|3.8I) . we see that 

K{T)-K\t) = (l,X7 T )-(iy T )+D(T)-^(T) 
= 1 - (1,V' T ) +D(T) -D'{T) 
> -e, 

which again contradicts the definition of T. 

Thus we have shown that T = oo or, equivalently, that K(t) > K (t) — e for 
every t 6 [0, oo) and e > 0. Sending e — > 0, we conclude that K(t) > k' (t) for 
t G [0, oo). In turn, when combined with (|3.6p . Corollary 14.31 and the fact that 
77 = 77 , we see that for every £ G [0, oo), we have 

D(t) - D\t) = J g(t- s) (~K{s) - if (s)) ds > 0. 
which concludes the proof of the lemma. □ 



G(s4 


-T)-G{x) 


1 


-G(x) 




-T)-G(x) 


1 


-G{x) 




-T)-G{x) 


1 


-G(x) 



Remark 4.8. A similar maximality property (in terms of a stochastic, rather than 
pathwise, ordering) is satisfied by "pre-limit" processes describing GI/G/N queues 
(see, for example, p] Theorem 1.2 of Chapter XII]). It is also worthwhile to note 
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the connection between Lemma 14.71 and a minimality property associated with the 
one-dimensional reflection map that is used to characterize single-server queues. In 
the latter case, the so-called complementarity condition plays the role of the non- 
idling condition here, and ensures minimality of the associated constraining term 
(see, for instance, [12]). 

4.3. Analysis of the Integral Equation (14. ID . Theorem 14.11 essentially states 
that the unique (weak) solution to the integral equation (14 . 1 j) is given by (14. 2|) . 
When M = oo, our proof of the theorem consists of two main steps, involving the 
following simpler integral equation for ~ft £ 2?.m <b (r + ) [0, oo): for every (p £ C](M? + ), 

(<p(-,*))Pt> = (<?(•> 0),/I Q ) + / (f> s (-,s),-p s )ds+ (ip x (-,s),-p g )ds 

(4.12) , Jo_ Ja 

+ / <p(0,s)dZ(s) 

J[o,t] 

for all t £ [0, oo). In Proposition ^. 91 we first show that the simpler integral equation 
(|4.12|) has a unique solution, and identify it explicitly. Then, in Proposition ^. 11[ we 
show that there is a one-to-one correspondence between solutions V to the integral 
equation (14. ip and solutions JL to the simpler equation (|4.12p . The proof for the 
case M < oo follows essentially the same line of reasoning, although it uses the 
following, slightly more involved, notation: let 

C C V( R +) = e Cl c(K) ■ su PP(^) C [0,M) x [0,oo)} 

and 

C C , M (K) = & G C C {M. 2 + ) : supp((^) C [0,M) x [0,oo)} . 

The reader may find it useful to first read the proofs under the supposition that 
M = oo, in which case C* M (K+) = C^{R 2 + ) and C C)M (M+) = C C (R%). 

Proposition 4.9. For any B,A1 £ (0, oo), given ~p £ A4<s(K+) and Z £ 
2r + [0,oo), a measure-valued function]! £ P J vt< B (K+ )IP> 00 ) satisfies for every 

(p £ C* M (R+) if and only if for every (p £ C c ,m(K+), 

(4.13) (0(-,f),/i t ) = / (p(x + t,t)-p (dx)+ [ <p(t-s,s)dZ(s) Vte[Q,oo). 

J[0,oa) JO 

Remark 4.10. Given any function / € C C (K + ) that has supp(/) C [0, M), we can 
identify / with a function <p £ C c .m(^+) that is only a function of x. So (|4.13p 
implies, in particular, that 

{f,Th)= I f(x + t)V (dx)+ [ f(t-s)dZ(s) Vte[0,oo). 

J[0 : oo) Jo 

Thus Proposition |3~9l shows that if P~T2"j) holds for all (p £ C* M 0R+) then the re- 
striction of the measure ~p t to [0, M), for every t £ [0, oo), is completely determined. 

Proof of Proposition \J^[ Suppose ~p = (~p t ,t £ [0, oo)) satisfies ()4.13|) . We first 
show that then (|4. 12|) is satisfied for any dp £ Cl >M (R%) and t = T < oo. Indeed, 
since ip s + (p x lies in C c ,m(IR+), substituting t = s and <p — (p s + <p x into (|4. 13jl . 
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integrating over s in [0, T) and applying Fubini's theorem, we obtain 
(if s (-,s) + if x (-,s),-p s )ds 

(<p s (x + s,s) + <p x (x + s,s))~p (dx)\ ds 

[0,oo) J 

— \ 

(<fi s {s — u,u) + <f x {s — u, u)) dZ(u) I ds 



o vo 

/ 

[0,oo) \ JO 



(<p s (x + s, s) + (p x (x + s, s)) ds n (dx) 



o 



T 



(fi s ((s — u, u) + ^? x (s — it, u)) ds dZ(u) 



(<p(x + T, T) - <p{x, 0)) Jlo(dx) + ( {(p{T -u,u)- (p{Q, u)) dZ(u). 

[0,oo) JO 

Another application of (|4. 1 3|) , with t = T, then yields the equality 

s) +<p x (-,s),fj, s )ds = (<p(-,T),[i T ) - (<£(•, 0),/z ) - / !fi(0,u)dZ(u), 



which proves that (p and fl satisfy (|4.12p , thereby establishing the "if" part of the 
proposition. 

To prove the converse, suppose and arc two measure-valued functions 
that satisfy (|3~T2|) for all (p G C\ M (K^_), define rj = /J (1) - /I (2) and let rj M = {?y t M , t G 
[0, oo)}, where rj^ is the restriction of rj t to [0, M). In order to prove the "only 
if" part of the proposition, it suffices to show that rj M = because this implies 
that the equation (|4. 12|) (holding for all <p G C* M (M+)) uniquely determines the 
family of functions {(<&(■, t), ~p t ), t G [0, oo)}, for (p G C c> m(K+), which must equal 
the right-hand side of (|4.13p due to the argument in the previous paragraph. 

Due to 632]), for every <p G C*([0, M) x R + ), we know that for f G [0, oo), 

(4-14) (£(.,t),rjf} = [ ($ x (., S )+<p s (; S ),rj¥)ds 

Jo 

and we also have 779 = and i]({0}, t) = for all £ G [0, 00). Now observe that rj M 
induces the following linear functional on C*([0, M) x R+): 

POO 

?7 M (.):^ / (<p,r}?)ds, 
Jo 

with 

\fj M ( l p)\<2B\\ l p\\ oc 

since for i — 1,2, /Is 1 ' has total measure no greater than B for every s G [0, 00). 
Thus rj M can be viewed as a Radon (in fact finite) measure on [0, M) x R + (see 
the comments in Section [OH} . Sending t — > 00 in (I4.14|) . the left-hand side goes 
to zero since ip has compact support, and so we have 

poo 

rj M {y x + <p s ) = (<p x (;s)+<p s (;s),ri¥)ds = V^GC c 1 ([0,M)xM+) 
Jo 

(which is equivalent to saying that r\ M is a weak solution to the linear, homogeneous 
PDE drj M /dx + drj M /ds = 0). It is straightforward to see that fj M = is the 
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unique Radon measure satisfying the above relation. Specifically, for any ip 6 
C\ ([0, M) x R+), if we let ip denote the natural extension of ip to R+: 

,7,<<r rt-/ if e [0 ' M) xM + 

Vl ' J ~ \ ifz>M 

then it is easy to verify that the function 

/>oo 

tp(x,t) = - i>(x + s,t + s)ds for (x, t) € [0, M) X E + 
./o 

lies in ([0, M) x R + ) and satisfies (in the classical sense) the PDE (p x + (p s = ip. 
This shows that rj M (ip) = for all ip E C*([0,M) x R + ). A standard approxi- 
mation argument can then be used to show that in fact rj M (ip) — for all ip E 
C c ([0, M) x R+), which is equivalent to the assertion r\ M =0. □ 

In order to state the correspondence between solutions to the integral equation 
(|4.ip of interest and solutions to the simpler integral equation 1|4.12|) . we will need 
the following notation. Given h E Cj oc [0, M), let 

(4.15) ip h (x,t)=exp(r h (x,t)) 

for (x,t) E [0, M) x R+, where 



(4.16) r h (x,t) 



x — t 



h(u) du if < t < x, 
h(u) du if < x < t. 



Note that then r h and ip h are continuous, locally bounded functions on [0, M) x R + . 
Hence, for every t 6 [0, oo) and any non- negative Radon measure £ on [0, M), 
ip h (-,t)£ defines a non-negative Radon measure on [0, M). 

Proposition 4.11. Given B,M < oo, ft 6 C[0,M), F E M< B [0,M) and~Z E 
2r + [0, oo), suppose ip h is the function defined in |^._?5| ). IfVE T> m <b [o.m) [0, oo) 
satisfies for all p E ( [0, M) x R + ) then the measure-valued function ~p E 

' D M< B (R+)[0,oo) defined by 



(4.17) -p t {A) = / ip h (x,t)v t (dx) V Borel A C R+ and £ G [0, oo) 

iAn[o,M) 

satisfies equation for all p E C^ M (R^). Conversely, ifJlE T^m <b (R+) [Pj 00 ) 

satisfies equation \4-12\ ) for all p E C^ M (R^_). t/ien £/ie measure-valued function 
V E £>m< b [0,M)[0, oo) de/med 

(4.18) v t (A)= [ -T-j- — rM t (dx) V 5oreZ A C [0, M) and t e [0, oo) 

J A ip h (x,t) 

satisfies UJ\) /or all p E C*([0, A/) x R + ). 



Proof. Fix B,M, h as in the statement of the proposition and let V> = i/j h . Since 
/i is continuous, it can be easily verified that ip lies in C^[0, M) and satisfies the 
partial differential equation 

(4.19) x p t + ip x =hip 
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on [0, M) x R+. Now, suppose v G '^ > m <b [o,m) [0, oo) satisfies (I4.1[) for all ip G 
C*([0,M) x M+). Choose ^ G Cc, M ( R +) and define ip = (pip on [0, M) x R+. Then 
ip G ([0, M) x R+), and so substituting the test function ip into (|4.ip . we obtain 



Due to (|4.19[) . the last term in the above equation is identically zero. Substituting 
the relation (|4. 1 T[) into the above equation, and noting that Vq — ~p and "0(0, •) = 1, 
we conclude that (|4. 1 2[) holds. Since (p G C* M (R+) is arbitrary, this proves the first 
assertion. 

The converse can be deduced in a similar manner and so only an outline of 
the proof is provided. Suppose (|4. 12f) is satisfied for all tp G Cl M (M.V), fix ip G 

Cc([0, M) xR + ), and let (p and denote the extensions of <p and V> _1 , respectively, 
to M (M.+ ) obtained by setting the functions equal to zero for x > M. Then, 
using (|4.12|) to study the action of ~p on the test function (p = ip -1 ^ G C^ A/ (M^), 
the fact that V" 1 satisfies the PDE flJi?]) on [0, M) x E + , but with h replaced 
by —h, and the relation (|4. 18[) . one can conclude that (|4. 1[) is satisfied for all 



We are now in a position to wrap up the proof of Theorem 14.11 

Proof of Theorem \4-l\ If V £ 'Dm <b [o,m) [0, oo) satisfies the equation (|4.1| for all 
(p G C\ ([0, M) x then Proposition ^. 1 II shows that the measure- valued function 
Dm, b( i +) [0,oo) defined by (|4~T7ll satisfies (|4~j~2l) for all ip G C^ M (K^_). In 
turn, Proposition 14.91 shows that then /I satisfies the explicit relation (|4.13|) for 
all (p G C^ M (M^_). Since Vq = fJ and F can be recovered from fj using (|4.18l) . 
it follows that there exists a unique solution v to (|4. 1|) that satisfies, for every 
<^ G C c ([0, M) x R+) and t G [0, oo), 



When ft, is the hazard rate defined in (|2.3p . elementary calculations show that 



Substituting the last relation and (fi(x, t) — f(x) for some / G C c [0, M) into the pre- 
vious equation, we obtain (|4~2"j) for / G C c [0, M). Since (1 - G(- + - G{-)) and 
(1 — G(-)) are bounded, the relation (|4.2p can then be established for / G Cb(IR + ) 
by approximating / by a sequence /„ G C c [0, M), using the fact that /„ satisfies 
()4.2p , then taking limits as n — > oo and invoking the bounded convergence theorem 
to justify the interchange of limits and integration. □ 





([0,M) xR+). 



□ 
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Remark 4.12. The only place where the continuity of the hazard rate h is used to 
prove continuity of the fluid solution map is in the representation given in Theorem 
14.11 In turn, continuity of h is used in the proof of Theorem 14.11 only in Proposition 
14.111 However, Proposition 14.111 can be shown to hold for any h g C} oc [0,M) for 
which (|3.4[) holds. The proof of the generalization involves some rather technical 
PDE approximation arguments that would involve the introduction of some more 
notation. In the interest of conciseness and clarity of exposition, we omit this 
generalisation from this paper. 

5. Functional Law of Large Numbers Limit 

The main objective of this section is to show that, under suitable assumptions, 

the sequence {(X^ N \v^)} converges to a process that solves the fluid equations. 
In particular, this establishes existence of solutions to the fluid equations. First, in 

Section I5TT1 we provide a useful description of the evolution of the state (X N ^ , ) 
of the iV-server model. Then, in Section 15. 2i we introduce a family of martingales 
that are used in Section l5~3l to establish tightness of the sequence {(„("), xW), we 
N}. Finally, in Section [53] we provide the proof of Theorem 13.51 

5.1. A Characterisation of the Pre-limit Processes. The dynamics of the 
Af-server model was described in Section 12.11 and certain auxiliary processes were 
introduced in Section [2.2l In this section, we provide a more succinct and convenient 
description of the state dynamics, which takes a form similar to that of the fluid 
equations. 

Throughout the section, suppose and initial conditions X^ N \0) e R+ 

and uf ] g X<i[0,M) are given, and let E^ N \ and i/W be the associated 

state processes, as described in Section 12.11 For any measurable function ip on 
[0, M) x R + , consider the sequence of processes {Ql^\N e N} taking values in 
R+, given by 

(5.i) qW(*)= £ £ vn^/^an^M^w^ 

where and a!j are defined by the relations (|2.6[) and (|2.5|) . Alternatively, we 

could replace the set {daf\s— )/dt > 0, aj N \s) = Vj} in the indicator function in 
(|5.1[) by the set {da" J N \s—)/dt > 0,da^ N \s+)/dt = 0}, which immediately shows 
that is .F^^-adapted. Moreover, when ip is bounded, it is easy to see that 

for each t g [0,oo), E[Q$°(t)] < oo if E[XW(0) +i?W(t)] < oo. Indeed, for any 
t e [0, oo), 

n\Q { fHt)\] < M^nxW^ + KW®] < || V3 || oo E[xW(0) + J BW(f)]. 

Also, from the relations (|2.5p - (|2.7p . it is easy to see that is equal to the 

cumulative departure process D^ N ) defined in (|2.4|) . 

We now state the main result of this section. Recall that for s g [0, oo), vi N ^ 
represents v^ N \s) and (tp(- + h, s), ^i JV ' ) ) is used as a short form for fr 0M \ f{x + 

h, s) vi N \dx). 
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Theorem 5.1. The processes (E^ N \ X^ N \ i/W) satisfy a.s. the following coupled 
set of equations: for ip G C\ ([0, M) x M+) and 7; G [0, oo), 



(5.2) 



(5.3) 
(5.4) 



(<p(;Q)A N) ) + j (M;s)+Vs(;s),vW) ds 

-Qi N) (t)+ f\(0,u)dK^(u), 
Jo 

lW(0) + #'(i)-Qf»(f), 
N-(l,4 N) ) = [N-XW(t)} + , 



where K^ N ^ satisfies 12. 5\) and is the process defined in \5. 1\) . 

The rest of this section is devoted to the proof of this theorem. We start with the 
simple observation that for any <p G ([0, M) x R+), due to the right-continuity of 



we have for any t G [0, oo), 



(5.5) 



[t/6] 

lim [(vO, (k + 1)6), u[^ 1)s ) - (*>, (., kS)AT) 

k=0 



In order to compute the increments on the right-hand side of the last equation, we 
observe that for ip G ([0, M) x M+), 5 > and s G [0, oo), we can write 



(5.6) 



(<p(',s + S)AJH) - (y(;s),vW) 



<*>(-, s + 8)- <p(., s), «/<$) + s)) _ M . s)) „w) 



We will treat the first term and the last two terms on the right-hand side of (|5.6p 
separately. Summing the first term, with s = k/n and 5 = 1/n, over fe = 0, . . . , [nt\ , 
we obtain 



(5.7) 



E 

fc=0 



(fc + 1) 



fe 



|nt| 

E 

fe=0 



i vv 



(fc+jO 



Since 9? G C^([0, M) x M + ), we have 



sup 

fe=0,..., [ntj 



1/r 



1/n 



fe + 1 



(JV) 

' ^(fc+l)/r, 



Since i/W has total mass no greater than N, and the mapping s \— > (y>t(-, s), i4 ) 
is right-continuous, taking limits as n — ► oo in (|5.7[) . we obtain the corresponding 
Riemann integral: 



[nt\ 



(5.8) limj 



(fe + i) 



(JV) 

'^(fe+i)A 



FLUID LIMITS OF MANY-SERVER QUEUES 



27 



In order to simplify the last two terms on the right-hand side of (|5.6| . for ip G 
C*([0, M) x M + ), <5 G (0, M) and s G [0, oo), first observe that we can write 

(5-9) (<p(;s),v£l)=I 1+ l 2 
where 

li= ip(x, a) u^Pgidx) and 2 2 = / s) i/+j(dx). 

«/[5,Af) J [0,5) 

We begin by rewriting X± in terms of quantities that are known at time s. For 
x > 5, customers in service with age equal to x at time s + S are precisely those 
customers that were already in service at time s with age equal to x — S > and 
that, in addition, did not depart the system in the interval [s, s + 5]. Since the age 
of a customer already in service increases linearly with rate 1 (see (|2.6p ). using the 
representation for i/ W given in (|2.7p , we have 

X l = ( ^( a r ) ( S + ,5 )' S ) a {5<af)( s +5)<,,} 

if(")( s ) 

51 ^( a r ) ( S )+^ S ) 1 {a< N '( s ) + 5< t , J } 



Y y(4 JV) ( s )+^ s ) i {a («) (s)< „, } 

J -=_(1, I ,W> + 1 

if< N >( s ) 

I] ^(4 Ar) ( s ) + ( 5, s )l {a( „) (s)< ^^ Q („ )(s)+5} . 

(Here, and in what follows below, we always assume wlog that S is sufficiently 
small so that the range of the first argument of ip falls within [0, M), ensuring that 

all quantities are well-defined.) Substituting the definition of z4 into the last 
expression, this can be rewritten as 

(5.10) T x = (ip(- + 6,s),vW)-qW(s,5), 

where for <p € C\ ([0, M) x M+), s G [0, oo) and S > 0, we define 

K(»)( s ) 

(5.11) g f>M) = £ P (af»( S )+M)l {o? ) (s)< „ j<of » (8)+jr 

J =-<i,,( N »> + i 

We now expand Z 2 - Since y> G C*([0, M) x R+), for every x G (0, <5) and s G [0, T] 
there exists y XtS G [0, x] C [0, <$] such that <p(x, s) — ip(0, s) = xip x (y XtS , s), where ip x 
is the partial derivative of ip with respect to x. As a result, we can rewrite I2 as 

^(0, S )^](dx)+ / {<p(x,s)-<p(0 t s))vW(dx) 

[0,5) J[0,5) 



= V(0, s)i/ + j[0,<5) + / a%(y X)S ,s)z/ + j(da;). 

"'[0,5) 

For any < r < s < 00, let K^- N ^(r,s) denote the number of customers that 
entered service in the period (r, s] and let d[ N ^ (r, s) denote the number of customers 
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that both entered service and departed the system in the period (r, s) . Note that 
Dl (r,s) admits the explicit representation 



(5.12) 



K<- N \s) 

^(r,-)= E \ a 



{a l f\s)=v 3 Y 



Also, note that ^+][0, 5) is the number of customers in service that have age less 
than 5 at time s + 5. These customers must therefore have entered service in the 
interval (s, s + S] and not yet departed by time s + S. Therefore, we can write 

v£l [0, 5) = (s, s + 6)- Di N) (s, s + S). 
Combining the last three expressions, we obtain 



(5.13) 



[0,6) 



Substituting equations (|5. 10[) and (|5. 13[) into (|5.9|) . with s — k/n and S — 1/n, 
we obtain for tp £ C 1 ([0, M) x R + ), 



IN) 

r\->-)>V{Ul)/„ 



<N] 



1 k 



\ n J \n n J \ n 



k 1 

n ' n 

D 



(JV) 



k fc + 1 



n n 



Fix t G [0, oo) and define t n = (\nt\ + l)/n. Summing the last expression over 
k = 1, . . . , \ nt\ , we obtain 



\nt\ 

£ 

fc=0 



(5.14) 



H-^n) AZ)/n) ~ (H^) A/1) 

L-i n \ l/ n ' fe/ ™ 



oS"'""(t) 



+ i:-(o^)^»(^)-4-"(o. 

fc=0 v 7 v 7 



where, for conciseness, for ip £ ([0> M) x R+), TV £ N and t £ [0, oo), we set 



|t/*J 



(5.15) 



Q^°' tf (*)= E ^ N) (k5,6) for£>0 



k=0 
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and, for n e N, 

LrrtJ 



n / \n n 

k=0 



{5A6) lUti ( k\ 

~J2 X{ P*\ V *&Z ) »(k+l)/n( dx )- 

k=0 -J[0,l/n) \ n J 

Since tp 6 C*([0,M) x JR + ), i/W[0,M) < N, and both the mapping s ^ 

{<Px(-,s),i/s ) and the process have right-continuous paths, it is clear that 

the first and third sums on the right-hand side of (|5 . 14[) converge pathwise, as 
n — > oo, to the corresponding Riemann-Stieltjes integrals: 

(-) - 1 i ( «±±lMi-Ml , ^ . £ <„,,, ., <. 

and, likewise, 

(5.18) lim^(o,%w(^)=/ ^(0, S )^W( S ). 



The next two results identify the limits of the remaining terms, Q^^' 1 ' 71 and R( N ^' n , 
as n — > oo. Recall the definition of the process given in (|5.1[) . 

Lemma 5.2. for ewer?/ iV e N, t E [0, oo) and ip e Q([0,M) x K+), Q$f ),5 (t) 
converges a.s. to Qp(t) as 6 — > 0. 

Proof. Fix TV 6 N, f e [0, oo) and <p G C^([0,M) x R+), and let L < oo be 

such that sup se[0it]>J/e[0)M) \<p x (y,s) + ip t {y,s)\ < L. For any 5 > 0, and j = 

-(1, + 1, . . . , 0, define r 5 (i) = and for j = 1,2,..., define 

T 5 (j) = mi{k e N : af°(iW + e) > Ve > 0}. 

Observe that r s (j)S represents the first time after the jth customer enters service 
that lies on the 5-lattice {k8, k = 0, 1, ... , [i/^J} (the introduction of e in the defi- 
nition was necessary to ensure that T S (j) = k if the jth customer arrives precisely 
at k5, and thus has age at that time). Then for any 5 > 0, a simple interchange 
of summation shows that 



)v (*) = E E V( a ? ( k6 )+ S > kS ) 1 { a< j N \kS)<v ] <a\ N >(kS)+S} 



KW(L*/.5J5) L*/<5J 

E E ^(afW+Wl.c 

i=-(l, V W)+l*=r«y) 



JV) (fc5)<i) J <a< N) (fc I 5)+5}' 



However, when a - (kS) < Vj < a,j (k8) + S, we have 



sup 

se[k5,(k+i)S] 



l p(a ( j N) (k6)+S, k6)-<f{vj,s) 



< LS 



and we also know that there exists a (unique) s 6 (k6, (k+l)§] such that da^- 7V ' ) (s—)/dt > 
and a^(s) = Vj (i.e., s is the unique time at which the customer departs the 
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system). Hence, we can write 

= E E K^.^^^^w^w^j + oW- 

Sending 6^0, since if W is cadlag, we see that Q^' S {t) converges to the quantity 

K<- N Ht-) 

y: e <m n 3 (^ s )^r\s- ydt > ,af > w =* } = «?°(*)- 

j=-(i,^ N) )+ise[o,t] 

The last equality follows by replacing if W (t— ) by K^ N '(t), which is justified (even 
though we need not have K^(t-) = K^ N \t)) because every Uj is a.s. strictly 
positive (since G(0+) = 0), and so if customer j enters service precisely at time t, 

then 1, (n), ,=0 for every s G [0,t]. □ 

\ a j \ s )— v j j 

We now show that a.s., R^ N '' n (t) — 0(l/n) uniformly for t in compact sets. 

Lemma 5.3. Almost surely, for every T G [0, oo) and every ip G C^([0,M) x K+), 

(5.19) lim sup #»'"(t) = 0. 

n ^°°te[o,T] 

Proof. We will establish the lemma by showing that a.s. for any <p G ([0, M)xR + ) 
both terms on the right-hand side of (|5.16[) converge uniformly to zero as n — > oo. 
Fix T < oo and t G [0, T]. Then for any n G N, from the representation (|5.12p for 

Di N ^ it immediately follows that 

J2 D * N) ( ) - E E 1 {»i<l« ^ E a K<l/n}- 

Since K^ N \T) is a.s. finite, by the dominated convergence theorem this in turn 
implies that almost surely, 

lim sup xWo,-V W)/fc fc + 1 
3 > T 1 fc=n ^ n ' 



K {N) (T) + 1 K {N) (T) + 1 

" I^^n^o E a {^<l/n} = IML E 1 fe=0}=0, 

i=i i=i 

where the last equality follows a.s. since G(0) = 0. The monotonicity in T of the 
convergent term allows us to conclude that there exists a set J7i of full P-measure 
on which this convergence holds simultaneously for all T. 

We now turn to the second term on the right-hand side of (|5.16p . Let C = 
su P v e[o,M),se[o,T] \<Px(y,s)\ < oo. Then for any t G [0, T] and neN, 

[nt\ [nt] 

E / \™Px(V*,k/n, k l n )\ "(kil)/n( dx ) - - E "(k+D/J ' V*)- 

k= J[0,l/n) k=Q 

Now, any customer that has age in [0, 1/n) at time (fc + l)/ra entered service strictly 
after k/n and has age > 1/n at any time k'/n, fc+1 < k! G N. Hence for any fixed 
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n € N, the unit mass corresponding to any given customer is counted in at most 
one term of the form ^(fc^WjJO, k £ N. This implies the elementary bound 

[ntj 

™p E -Si)/. [°. v») < + £ (Ar) cr + 1)- 

Now let n 2 be the set of full P-measure on which the property (0) + (t) < 
oo for every t S [0, oo) is satisfied. Then on 2 , the right-hand side of the last 
expression, which is independent of n, is a.s. finite. Therefore, dividing both sides 
of the last relation by n, the resulting expression clearly tends to a.s. as n — > oo. 
Thus we have shown that on the set f2i n f^2 of full P-measure, (|5.19[) holds for 
every T < oo and tp £ C^([0, M) x R+) □ 

We are now in a position to complete the proof of Theorem 15.11 



Proof of Theorem I5.il Fix N £ N. The left-hand side of (|5.5p is clearly equal to 
(cp, v^n } — {if, ^q N ^), where recall i" = ([^ij +l)/n. Since i/W is right-continuous, 
as n — > oo this converges to ((p, v\ ) — ((p,UQ ). On the other hand, combining 
(HU), (JSIHJ), (pnij) . (|5T7|l . (|5TT5|) and Lemmas I5"21 and [53) it follows that the right- 
hand side of (|5.5p a.s. converges, asrn oo, to 

' (^ t (; S ) + Vx (;s),^) ds - Ql N \t) + [ V {Q,s)dKW{s), 



[0,t] 



which proves (|5.2|) . The remaining relations (15. 3p and (|5.4j) follow immediately from 
([2~4]) . ([2~9]) . (l2~Tu]) and the observation that Q[ N) = ])W (see the comment below 

(EJ)). □ 



5.2. A Useful Family of Martingales. An inspection of the integral equation 

(|5.2p suggests that identification of the limit of the sequence {(JT J ,pW)} of scaled 
state processes is likely to require a characterisation of the limit of a scaled version 

q\p ■* of Q\^\ In order to achieve this task, we first identify the compensator of 

(in Corollarv l5.5p and then identify the limit of the quadratic variation of the 

associated scaled martingale , obtained as a compensated sum of jumps (see 

Lemma I5.8j) . 

We begin by introducing some notation. For any ip £ C&([0, M) x R+), consider 
the sequences of processes {A^\ N £ N} defined by 

(5.20) AW ( t ) = f ( f yfa S ) h ( x ) „W ) ds 

JO \J[0,M) J 

for every t £ [0, oo). We now derive an alternative representation for the process 
which shows, in particular, that A^\t) is well-defined and takes values in 
R + for every t £ [0,oo). For j £ N, let a^ N) = iiw [K^ij) be the time that the 
jth customer entered service (recall the definition of inv given in (|3. 15[) V Then, 
interchanging the order of integration and summation and using the linear increase 
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of the age process, for t G [0, oo) we can write 
(5.21) 

/ K^ N \s) 



ds 



j=-< 

K (N \t 



E f * (^(0) + .) (af>(0) + s, s) lr(,, (0)+s< „ j} 
- N) (*) .* 

+ E / (N) /i ( s - (T fV( s " ,T ^ ) ' s ) a {^r ) ^} ds - 

(JV) 

Since i>j < M a.s. and /i is locally integrablc on [0,M), this shows that A is 
well-defined. Now, let Jj ^ be the (random) set of jump points of the departure 
process upto time t: 

J^ = {sG[0,t}:D^(s)^D^\s-)} 

and set jW = = U t>0 J { t N) . Recall that Q[ N) = DW. We start by identifying 
the compensator of D^. 

Lemma 5.4. For every iV G N, ifte process is the f^' -compensator of 

the departure process D^ N \ In other words, is an increasing, -adapted 

process, with E[A^\t)] < oo for every t G [0, oo), such that for every non-negative 
t[ N ^ -predictable process Z, 



(5.22) 



E 



E 



E 



I™ zA f h(x)uW(dx)\ ds 
J a \J\o.M) I 



Proof. Fix TV G N and label the servers from 1,...,N. In order to prove the lemma, 
we shall find it convenient to introduce the following notation. For k = 1, . . . , N 
and n G N, let 6^' k (respectively, (i N * > ' k ) be the time at which the nth customer 
to arrive at station k starts (respectively, completes) service. We also let D^ N ^ k {t) 
represent the total number of customers that have departed the fcth station in the 
interval [0, t], and let S^ N ^' k (t) be the number of customers that are currently being 
served at station k at time t (note that for every t G [0,oo), S^' k {t) takes the 
value or the value 1). Then clearly 

DW=f^£>W' fe and (pC),l) = f S^ 1 . 
fe=i fe=i 
For conciseness, for the rest of this proof we shall omit the explicit dependence of 
all quantities on N. 

For k = 1, . . . , N, the process D k = D^ N ^ k admits the decomposition 



If we define 



71=1 

D k =D k (tA( k )-D k (tA9 k ) 
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to be the one-point process of the nth departure from station k, then we assert that 
the ^-"t-compensator of D„ is given by the process A^, defined for t £ [0, oo) by 



A k n (t) 



if tG [0,0*] 

h(u-e k n )du if te 



h(u-9 k ) du if t G (Cn; 00 )- 



It is straightforward to verify that 9 k and ( k are both jF t -stopping times (this 
can be done by rewriting the events {9 k < t} and {( k < i} as events involving 
{af \s),sf ] {s),s G [0, t],j G {-TV + 1, ... ,0} U N} — the details are left to the 
reader). As a result, it follows that A^ is J-j-adapted. Moreover, by definition 
A„ is continuous, and hence .^-predictable. Thus in order to establish the claim 
that it is the (.^-compensator for D k , it only remains to show that for every non 
negatives-predictable process {Z t }, 



E 



Jo 



Z s dA k n (s) 



As is well known, the predictable filtration is generated by indicators of stochastic 
intervals, i.e., by processes of the form Z = 1[o,t]j where T is any ^-stopping time 
[13l Theorem 2.2]. Hence it suffices to show that for every ^-stopping time T, 



E 



= E 


[I 







l [0 ,T\{8)dA*(8) 



By an application of the monotone convergence theorem, it is clear that it in fact 
suffices to show that the above holds true for any bounded stopping time. Now, 
note that, because neither D k nor A k increase outside (9 k , ( k ], the last equation is 
equivalent to the relation 



E 



l[o,T]n(^,oo)(s)^(s) 



l[0,T]n(^,e]( S ) d ^n( S ) 



However, the term on the left-hand side can be rewritten as 



E 



p OO 

/ l[o,T]n(e* oo)(s)d-D*(s) 
Jo 



lim E 

m — >-oo 



3=0 



Since T, 9 k and C, k are all ^-(-stopping times, conditioning on J~j/2™ an d using the 
fact that the age t — (9 k A t) at time t of the nth customer to enter service at station 
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k is Tgk -measurable, it follows that for any m € N and j — 1, ... ,2 



E 



a R<^<T} a {^<e<-^} 



= E 
= E 

= E 



1 {^<2*r<T,CS>^} 1 {a<^}l jr ^] 



1 {«'i<^<T,c;>2ir} 



J/2" 



g(" - gfc) 



*2) 



1 



Combining the last two displays and invoking the monotone convergence theorem, 
we conclude that 



E 



/'OC 

/ a [o,T]n(e*,oo)(s)d£>*(s) 



lim E 

m^oo 



j=0 



To complete the proof, it only remains to show that the right-hand side of the 
last equation is equal to E[J °° 1[o,t] ( s ) dA^(s)\. For this, first note that the term 
within the expectation on the right-hand side of the last equation can be rewritten 
in the form E[/ °° 1[o,t] ( s )^m,n( s )] where, for m 6 N, A^ nn is the random measure 
defined by 



3=0 



G(^-0>))-G(£-0£M) 



where ^ is, as usual, the Dirac mass at x. Next, observe that 

g{u - o k n ) 



i - G(u - ei - ±) 



< ^m,n[0,Oo) 



< 



r k -i- 1 



1 



G(u- 



Since C« — represents a service time, it is distributed according to G. Hence 
G^Cn — 9%) is uniformly distributed in (0,1). Since G is continuous, for every u, 
there exists a sufficiently large m = m a (uj) such that for m > m , G(C*(w) — 
+ l/2 m ) < 1, so that -ln(l - G + ^_ - 0*(w))) < oo. Combining 

the last three statements, we conclude that for each u, n (w)[0, oo) is finite for 
sufficiently large m and, moreover, that as m — > oo, A k nn (uj) converges vaguely to 
the measure that has density 

g(u-6 k n {uj)) (jk(,,\\-n 
l-G{u- 6 k {uj)) le n(")<»<C£(")> - h \ u - On{u))He*(u)<u<t!i(u)}, 



FLUID LIMITS OF MANY-SERVER QUEUES 



35 



which is precisely the measure dA!^(u)). The latter measure does not charge points, 
and in particular does not charge u = T(u>). So we conclude that for every u>, 



lim 

m — >oo 



l[0,TM]GWm,„M 



l[o,T(,)]«„(w) < / h{u)du, 



where L is an upper bound on the stopping time T and the last term is finite due to 
the local integrability of the hazard rate function on [0, M) (note that if M < oo we 
may restrict our attention to stopping times T < 9^ + M) . The limit above, along 
with the bounded convergence theorem, then implies the desired convergence: 



lim E 

m— >oo 



lim 



n) 



l[o,T](«) dA^ >n (u) 
\ %T ]{u)dA k n {u) 



This establishes (j02]) . In particular, this shows that E[A[ N) (t)} = E[D<W(t)] < 
E[£W(i) + lW(0)] < oo, which guarantees that A[ N) is locally integrable. □ 



^From the last lemma and the comments below (15. ip . it is clear that for every 
<p G Cb([0,M) x E + ) and t G [0, oo), Q% ,(t) and A^\t) have finite expectation. 
Together with the fact that the ages of customers are (left) continuous and hence 
predictable, the last lemma immediately implies the following (seemingly stronger) 
result. 



(JV) 



the 



(N) 



Corollary 5.5. For every ip G C&([0, M) x K+), the process A, 
compensator of the process ■ In particular, the process defined by 

(5.23) M™ = - A™ 

is a local -martingale. 

(JV) (N) (AT) 

As usual, let Q v , A^ and , respectively, denote the scaled processes 

Q { * ] /N, A^/N and M^/N. The following lemma will be used in Section EH 
to establish tightness of these processes. 



Lemma 5.6. For every T < oo, sup^E 
N G N, 



(JV) 1 

D (T) < oo. Also, for t G [0, oo) and 



(5.24) 



lim E 

5^0 



D iN \t + 5)-D [N \t) 



= 0. 



Moreover, for every 6 > and interval Z = [L + S, M) with L G [—5, M — S), 



(5.25) 



E 



Q[ N z \t + 6)- QT z '(t)\Fr J < U(6)vr'[L + , M) 



(N) 



7 Wr 



where U(-) is the renewal function associated with the service distribution G. 
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Proof. For notational conciseness, throughout this proof we will use f(t, t + 6) to 
denote f(t + S) — f(t) for any function /, t € [0, oo) and S > 0. Since \z is only a 
function of X, we can write 



QZ\t,t+s)= Yl E 



{da,, '(s- 



)/dt>0,af°(s)=^} Z 



which is simply the number of departures from the JVth system during the time 
interval [t, t + 5} by customers whose service times lie in the set Z at the time of 
departure. 

We shall bound the departures during the time interval [t, t + 8] in the Nth 
system by the departures in another system that is easier to analyse. Consider a 
modified system in which after time t, there are an infinite number of arrivals (or, 
equivalently, customers in queue) so that at each station, every time a customer 
finishes service, a new customer joins. Let -Di(<5|:e) denote the number of departures 
from one station in this modified system during the period [t, t + S], given that at 
time t there exists a customer with age x in that station (note that, as the notation 
reflects, this quantity is independent of t and the choice of station). In fact, The 
quantity D\{5\x) is simply the number of renewals in the interval [0, 6] of a delayed 
renewal process with initial distribution that has density go(y) — g(y+x)/(l— G(x)), 
and inter-renewal distribution G. Thus, as is well-known (see, for example, Theorem 
2.4(iii) of [1 ), E[£>i(5|a;)] is bounded above by U(6), where [/(•) is the renewal 
function of the pure renewal process that has inter-renewal distribution G (and a 
renewal at 0). 

Let D(t,t + s] be the departure process from this system during the interval 
(t, t + s]. Since both the original and modified systems are in the same state at 
time t, and the cumulative arrivals into service in the modified system are greater 
than in the original system, a simple monotonicity argument shows that 



E 



D {N \t + 5)-D (N \t)\T[ N) 



(5.26) 



< 



< 



-E 



D{t,t + 5]\T i 



1 

AT 
TV 



U(6)ui N) [0,M) 



(TV) 



/ E 


Di(S\x) 


l[0,M) 





(dx) 



< U(S). 



Now, U(S) is finite for any finite 5 and non-decreasing (see, e.g., Theorem 2.4(i) 
of [I]). Taking t — and 6 = T and expectations on both sides, this immediately 

shows that sup^gpjEfZ) (T)] < U(T) < oo. Also, since E[£>i(<5|x)] converges 
monotonically down to zero as 6 — > 0, the bounded convergence theorem shows 
that for every N G N, 



lim 

5^0 



/ E 


Di(8\x) 


l[0,M) 





v[ N) (dx) = 0. 



Taking expectations of both sides of (|5.26[) and then sending S — * 0, the last display 
and another application of the bounded convergence theorem then shows that for 
every JVeN, (RT!M|) holds. 
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To establish the second estimate, fix S > and L 6 [—6, M — S). If L < then 



the left-hand side of (|5.25[) is bounded by E[D (t, t + d)\J-^ '] and so the bound 
(15.25)) follows from the second inequality in (|5.26p . Now suppose L G (0, M — 6). 
Then any customer whose service time is greater than or equal to L + 8 and who 
departed the system during the time interval [t, t + S] must have been in the system 
at time t with age greater than or equal to L > 0. Thus the total number of such 
departures is bounded above by the number of departures in the modified system 
from stations that had a customer present at time t with age greater than or equal 
to L. By the same reasoning provided above, this implies that 



E 



(N) 



< / E 

J[L,M) 

which completes the proof of the lemma. 



D!(S\x) v\ N \dx) < U(S)v\ N) [L,M), 



□ 



We now use this estimate to establish some convergence results, which will be 
used to prove tightness in Section 15.31 The assumptions (|5.27[) and (|5.28j) of the 
lemma below are shown to follow from Assumption QJ3) in Lemma 15.101 



Lemma 5.7. Suppose that the limit 



(5.27) 

holds and, if M < oo, then 



lim sup E 



4 N \L,M) 



(5.28) 



lim sup E 



1 - G(L) _(jv)/ , \ 



I[o,l) 1 ~ G{x) 

is also satisfied. Then for t 6 [0, oo) , the following three properties hold. 
(1) 

h(x)v{ N) (dx) \ ds 



lim supE 

L^M N ,/n \J[L,M) 

(2) For every y E C fc ([0, M) x M+), 




lim lim sup E 

.5-0 N 



sup Ul N \t + 5) 
te[o,T] v 



= 0. 



= 



lim lim sup I 



Q { ;\t- 



8) 



Q ( :\t) 



0. 



(3) Given L < M and any sequence of subsets Hr C [0, L] such that the 
Lebesgue measure of Hji goes to zero as R — > oo, we have for every t G 
[0,oo), 



(5.29) 



lim lim sup I 



sup A*J (t) 
te[o,T] 



0. 



Proof. As in the last two proofs, throughout this proof we will use f(t, t + S) to 
denote f(t + 6) — f(t) for any function /, t G [0, oo) and S > 0. We shall divide the 
proof of the first property into two cases. 

Case 1. M = oo. We start by proving a preliminary result, (|5.31[) below. Due to 
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the linear increase of the ages of customers, the assumed limit (|5.27p automatically 
implies that for every s G [0, oo), 



(5.30) 



lim supE v[ N) [L + s,oo) 



= 0. 



For L, A, s G [0, oo), let Jl,a,s & Cfc(R+) be such that 

l[2L+A+s,oo) < Jl,A,s < l[L+A+s,oo) 

Then by Lemma I5"^31 and (|5.25[) . we have for every TV G N, 
A { f N L lj s , s + A)\^ 



E 



< U(A)V^[L + s,oo) 
Taking expectations of both sides, we see that 



(5.31) 



E 



.4 



(s,s + A)l < U{A)E |z/W [L + s, oo) 



We now show how the first property (in the case M = oo) follows from the the 
above estimate. Fix t G [0, oo), choose L > t and let L = (L — t)/2. Then we have 



E 



[L,oo) 



h(x)ui N \dx) ds 



E 



< E 



[2L+t, 



h{x)v[ N \dx) ds 



4 N) (t) 

JL,t,0 v ' 



< U(t)E \v ( N) [L,oo) 

where the last inequality is justified by the estimate (|5.3ip . with L, A and s replaced 
by L, t and 0, respectively. Taking the supremum of both sides over N, and then 
sending L — » oo (in which case L — > oo), the relation (|5.27p ensures that property 
(1) holds for the case M — oo. 

Case 2. M < oo. In this case, for L < M, it is not hard to infer that 



E 



< E 



[L,M) 



h(x)vi N \dx) ds 



V^(L,M) 



.l] V 1 - G ( x ) ) ( 



(G(M)-G(L))E \E {N \t) 



where the last inequality uses the independence of the arrival process and the service 
requirements of the customers. Taking the supremum of both sides over N and then 
sending L — s- M, (|5.27|) . (|5.28[) and Assumption 1(1) ensure that property (1) is 
satisfied. 

We now turn to the proof of property (2). This property holds for all ip G 
Cb([0,M) x M+) if and only if it holds for ip = 1. Moreover, to establish the 
property for ip = 1, we claim that it suffices to show that for every L < M, 



(5.32) 



r (at) 

lim lim sup E i,, , (t, t + S) 

s^o N L JL i°. I '] v 



= 0. 
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To see why this is true, observe that for any L < M , we have 

r t+8 



E 



A[ N \t,t + 5) 



= E 



-E 



[0,L) 
t+8 



h{x)v{ N \dx)j ds 

x) ds 



[L,M) 



Taking limsup over N, and then sending S — ► 0, (|5.32|) implies that the first term 
vanishes. Subsequently sending L — > M, the second term goes to zero by property 
(1), thereby yielding the first relation of property (2). The second relation then 
follows trivially from the first on account of Corollary 15. 51 

In order to establish (|5.32[) . for S > we first rewrite A%^ (t, t + 5), in a manner 
analogous to (|5.21|) , as 



E 



t+S 



S)1 {a'fH0) + s<L} dS 



K {N \t+S) t+s 

E 



< 



+ E^(t + 6) 



sup 

uG[0,L] Ju 



3 

u+5 



/i(r) dr. 



Since L < M, the local integrability of /i on [0, M) implies that 

r u+5 



sup 

u£[0,L] Ju 



h(r) dr ^ as 5 -> 0. 



Therefore, dividing the previous relation by N, taking the supremum over t £ [0, T], 
then taking limits first as N — > oo, and then 5 — > and invoking Assumption [Tfl ) 
we see that, a.s., 

lim limsup sup (*, * + <*) < t 1 + C L (5) = 0. 

<5^0 at^oo fe[0,T] ' 

Since E[25(T)] < oo by Assumption HJl) an application of the dominated conver- 
gence theorem then yields (|5.32|) . 

The proof of the last property of the lemma is similar to that of (15.32|) . Indeed, 
using the representation (|5.2ip and, arguing as above, we can conclude that for any 

T < oo, 



limsup sup E (t) 
n te[o,r] L R 



< 



[1 + E[E{T)}) / h{r)dr 



Hr, 



Since the sets Hr are all contained in a compact set in [0, M), taking limits as 
R — > oo, the right-hand side vanishes due to the local integrability of h. □ 



N 



( TV) 

We now show that the quadratic variation process (M^ } converges to zero, as 

— (JV) 

oo. M. has a well-defined predictable quadratic variation process because 
— ( N ) 

the fact that M v is a compensated sum of jumps with bounded jump sizes auto- 
matically implies that it is locally square integrable (see, for example, (4.1) on p. 
38 of [13]). 
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Lemma 5.8. For every ip e Cfc([0, M) x 



(5.33) 

Consequently, 



lim E 

A^oo 



(M ( v N) )(t) 



) and t £ [0, oo) ; 
= 0. 



as N 



Proof. Since the compensator is continuous, the martingale does not 

have any predictable jumps, and so by Proposition II. 2. 29 of JT3J page 82], the 
predictable quadratic variation of the martingale is given by 




[0,M) 



<p 2 (x,s)h{x)v { s N) {dx) ds. 



This means that the scaled process M 
which implies that for any t S [0, oo) 



(A) 

v has predictable quadratic variation 
t 

V 2 (x,s)h(x)V {N} 

[0,M) 




>(dx) ds 



Since E[A[ (t)] = E[D {N) (t)) by Lemma El the estimate in ([5T26]) (with s and t 

there replace by t and 0, respectively) shows that supjy eN Epl^ (t)] < U(t) < oo, 
where U(-) is the renewal function associated with the service distribution G. Thus 
taking first expectations and then limits as N — > oo in the last display, we obtain 

(A) 

the first assertion of the lemma. In order to show that M v =>■ as N 
note that by Doob's Lemma, for any A > 



oo, we 



sup M v > A 
ae[o,T] . 



< 



E[(M ( V N) )(T)} 
A 2 



which converges to as N —> oo by the first assertion. Since this is true for all 
A > 0, this completes the proof of the lemma. □ 



5.3. Proof of Relative Compactness. We now establish the relative compact- 
ness of the sequence of scaled state processes {(X^,F^),JV G N}, as well as of 
several of the auxiliary processes. For this, it will prove convenient to use Kurtz' cri- 
teria for relative compactness of processes {Y 1 * N '} with sample paths in 2?r + [0, oo). 
Kurtz' criteria. 

Kl. For every rational t > 0, 

(5.34) lim supP(r (Ar) (i) > R) = 0; 

K2. For each t > 0, there exists > such that 



(5.35) 



lim sup I 

5-0 at 



0. 



The sufficiency of these conditions for relative compactness follows from Theorem 
3.8.6 of [7] (condition Kl corresponds to condition (a) of Theorem 3.7.2 in [7] and 
condition K2 follows from condition (b) of Theorem 3.8.6 and Remark 3.8.7 in [7]). 
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Lemma 5.9. Suppose Assumption\]\holds. Then the sequences 

(JV) (JV) (JV) 

and, for every <p G C&([0, M) x R+), the sequences {Q^ }, {A^ } and {D } are 
relatively compact in Pr + [0, oo). 

Proof. By Corollarv l 5 . 51 and Lemma 
and t G [0,T], 

supEfZjfV)] = supE[Qf \T)] < I^IUsupE^^^T)] < oo. 

JV JV JV 

This is easily seen to imply that {Aff^} and {Q^} satisfy condition Kl. 



we know that for every <p G Cb([0, M) xR + ) 



In 



I 2 ), {Al N) } and 



addition, from Lemma I5.7f 2) it follows that for every ip G Cb{ 

(JV) 

{Q v } satisfy criterion K2 (with [3 = 1), and thus they are relatively compact. 

(TV) (JV) (JV) 

Since D — Qi , this also implies that D satisfies conditions Kl and K2 (the 
latter with j3 = 1). 

By Assumption [l] the sequences {E } and {X (0)} are relatively compact. 
Therefore, by Theorem 3.7.2 of [7], they satisfy (|5.34|) . The elementary bound 

(lM N) )<X iN \t)<X {N \0) + E {N \t), 

then shows that the sequences {X {N) } and {(1,fW)} also satisfy condition Kl. To 
complete the proof of relative compactness of these sequences, we will use a slightly 
different set of criteria, namely Kl above and condition (b) of Theorem 3.7.2 of [7], 
which is expressed in terms of the modulus of continuity w'(f,6,T) of a function 
/ (see (3.6.2) of [7] for a precise definition). Now, for every < s < t < oo, from 
(|5.3[) it is clear that 



x (N \t) 



< 



E iN \t) 



E iN \s) 



D iN \t) 



D iN \s) 



and the complementarity condition (15. 4ft shows that 



(1,PW)-<1,EW) 



(JV)N 



< 




[i-xr 


+ 




+ 


< 















X 



(JV) 



X 



(JV) 



From this it is easy to see that for every N G N, 6 > and T < oo, 



w'{(l,V^),8,T)Ww'(X {N \s,T) < w'(E {N \5,T)Vw'(D iN \5,T). 



The relative compactness of {X } and {(1, ^ ')} is then a direct consequence of 

the above estimate, the relative compactness of {E } and {D } and Theorem 
3.7.2 of 0. □ 

Next, we show that the sequence of measure- valued processes {77^} is tight. 
We shall first establish tightness of the measure- valued process {v^}, defined by 



(5.36) 



where V"' = 1 — (l,I7^ JV - ) ) is the process that keeps track of the fraction of idle 
servers in the Nth system. In other words, for every Borel set A C [0, M) and 
t G [0, oo), we have 



(A) = l A (0)I (N \t)+vr>(A). 



(N), 
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The reason for introducing i>W is that now for every t, v[ N ^ is a probability measure 
(as opposed to a sub- probability measure), and so v^ N ' is a random element taking 
values in IVii[o,M) [0, 00). Thus, in order to prove tightness of the sequence {p^ N '}, 
we can apply Jakubowski's criteria for tightness of measures on 2^Xi[o,m) [0, 00), 
which are summarised below (see, e.g., [T3] or Theorem 3.6.4 of [3] for the case 
M = 00; the conditions listed below for the general case M < 00 follow by analogy). 

Jakubowski's Criteria. A sequence {y( N >} of 2?Mi[o.m)[0, oo)-valued random ele- 
ments defined on (Q, J 7 , P) is tight if and only if the following two conditions are 
satisfied. 

Jl. For each T > and 77 > there exists a compact set K-t. v C Mi[0,M) 
such that for all N G N, 



(v ( t N) G /C T) , for all t G [0,T]) > 1 



This is referred to as the compact containment condition. 
J2. There exists a family F of real continuous functions F on .Mi[0, M) that 
separates points in Ali[0, M) and is closed under addition such that {u^} 
is F-weakly tight, i.e., for every F G F, the sequence {F{&s), s € [0, 00)} 
is tight in Pr[0, 00). 

Lemma 5.10. Suppose Assumption^ holds. Then the sequence {D^} satisfies 
Jakubowski's criterion Jl. Moreover, the limits |5.£7[ ) and \5. 28\) hold. 

Proof. We split the proof into two cases, depending on M. 

Case 1. M — 00. By Assumption QJ3) and the complementarity condition l|5.4[) . 
there exists a set f2 of measure 1 such that for all w e f!, Vq{w) converges 
weakly, as N — > c», to a sub-probability measure Vq{u), which in turn implies 

that 7 {N) (0)(uj) converges to 7(0) (w) = 1 - (l,z7 (u;)). Fix w G O. Then by Pro- 
horov's theorem (see Section 3.2 of [7]), the sequence {u^ N \uj),N G N} must be 
tight, and hence for every e > there exists a constant r(ui,s) < 00 such that 

i>h N) {u) ((r{w,e),oo)) < e for all G N. 

Since r(u>, 1/n) < 00 for every u> G f2 and n G N, there exists a sequence r(n) that 
converges to 00 as n — > 00 such that P(o> : r(w, 1/n) > r(n)) < 2~ n . If we define 
A n = {ui : r(ui, 1/n) > r(n)}, then by the Borel-Cantelli lemma, almost surely A n 
occurs only finitely often. Furthermore, P (U n >N A n ) < 2~ N ° for every Nq G N. 
Now fix T < 00, and note that since the age process of each customer in service 
increases linearly, for every n G N and t G [0, T], 

oj : u[ N \uj){r{n) + T, 00) < — 

n 



C 



Thus given 77 > 0, now define 

K. n . T = |/i G Xi(K+) : At (r(n) + T, 00) < - for all n > Ar (r?)| , 
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where we choose Nq(t]) = — [In 77/ In 2] so that 2 N ° < rj. Then observe that 
inf sup /i(C c ) < inf sup n(r(n) + T, 00) = 0. 

CCR+:C 'compact ^gK, 1: t n>N (ri) M e/C„,T 

Therefore, another application of Prohorov's theorem shows that /C^t is a relatively 
compact subset of A4i(R+) (equipped with the Prohorove metric). Let /C^t be its 
closure in the Prohorov metric. Then for every N £ N, 

P (v> ( t N) £ K n ,T for every t £ [0, T] 

> P U^^n), 00) < - for every n > N (r)) \ > 1 - 2 _JV ° > 1 - 77, 

which proves the compact containment condition when M = 00. 

In addition, this also shows that (|5.27|) holds. Indeed, if 77 > and Ni(rj) £ N 
satisfies Ni(rj) > Nq(i]) V [I/77] , then the last display implies that for every K > 
r(JVi (»/)), 

inf P f ^[isT, 00) < — ) > 1 - >h, 
which in turn shows that for every for every K > r(Ni(rj)), 



supE V ( q'[K,oo) 

NGN L 



1 

< — + Tj. 



The result then follows by letting first K — > 00 and then 77 — > 0. 
Case 2. M < 00. We start by establishing (|5.27[) and (|5.28|) using an argument 
similar to that used in Case 1 to prove (|5.27p . The almost sure weak convergence 
of Fg^' to Vq in M.<i[0, M) implies that the sequence (r(n)) considered in Case 1 
can be taken strictly smaller than M and converging to M. Defining TVi (77) and K 
as in Case 1, we see that for K > r(Ni(j])), 



sup E 

NGN 



4 N) [K,M) 



and the result follows as above by sending first K — + M and then 77 — > 0. The 
limit (I5.28P follows from the weak convergence of to and the fact that 
(1 — G(L))/(1 — G(x)) is bounded (by 1) and continuous on [0,1/). 

It only remains to show that the compact containment condition is satisfied 
when M < 00. For this, we need to show that for every e > 0, 77 > we can find 
L(e) < M so that 

inf P (v ( t N) [0, L[e)] > 1 - e for every t £ [0, T] \ > 1 — r,. 

However, for any L < M, we have 

P (v ( t N) (L, M) > e for some t £ [0, T]j < P (p^ m) (T + M) > e) 



< 



e 

E[A^ LM) (T + M)] 

e 

where the last equality follows from Corollary [531 Using now Lemma l5~7T l') (which 
is justified since we have already established (|5.27[) and (|5.28[) ), one can find L(e) 
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close enough to M to make the supremum over N of the right-hand side above 
smaller than 77, thus yielding the desired result. □ 



Lemma 5.11. Suppose Assumption^ is satisfied. Then for every f G CHO, M), 
the sequence {(/, u. )} of Dr[0, oo)-valued random variables is tight. 

Proof. Let / G [0, M). By Prohorov's theorem, it suffices to establish relative 
compactness of the sequence {(/, i>. )}. First substituting ip = f (interpreting 
/ as a function on [0, M) x R + that depends only on the first variable) in the 
equation (|5.2[) satisfied by the prelimit, then dividing the equation by N and using 
the definition of we obtain for any t G [0, 00), 

(f,*l N) )-{fA N) ) = (/,^>-(/,^>+/(0)P (W, (t)-7 (W) (0)] 

\f,i>W)ds-f>(0) f t l iN \s)ds 
Jo 



-,, f (t) + f(0)[K^\t) + f N \t)-f N \0) 

(f,i>W)ds-f>(0) f t l (N \s)ds 
Jo 

where the last equality uses the relation W +T"'-T '(0) = W ' = Qi , 
which follows from ([^5]) and ([23]) . Thus to show that {(/, T7 (JV) )} is relatively 
compact, it suffices to show that {(/, v Q N ^)} and the sequences associated with each 
of the four terms on the right-hand side of the last display is relatively compact. 
Lemma [531 immediately guarantees this for the last two terms and Assumption[Tj3) 
ensures this for {(/, Vq )}. In addition, since v^ N ^ is a sub-probability measure 

—<N) 

and / (s) G [0, 1] for all s, for every N G N, the first two terms are uniformly 
bounded by H/'H^i and, moreover, 

r t+u 



(f'A N) ) 



V 



/'(0) l t+U I (N \s)ds 



< ll/'llc 



This verifies Kurtz' criteria Kl and K2 (with (3 — 1), and thus establishes relative 
compactness of the sequences associated with the remaining two terms. □ 

We are now ready to state the main tightness result. 

Theorem 5.12. Suppose Assumption^ is satisfied . Then the sequence 
{(X {N \v iN \A[ N \Q < 1 N) ),Ne N} is relatively compact. 

Proof. Relative compactness of the sequences {X^}, {A^ } and {Q^} was 
established in Lemma l531 Consider the family of real- valued functions on Mi [0, M) 

¥ = {F :3f G Cl[Q, M) such that F{p) = (/, /i) V/i G Mi[0, M)}. 

Then every function in F is clearly continuous with respect to the weak topology 
on Ali[0, M) and the class F is trivially closed with respect to addition. Moreover, 
F clearly separates points in Aii[Q, M). Then tightness of the sequence 
follows from Jakubowski's criteria, Lemma 15.101 and Lemma 15.111 On the other 
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hand, fW = i>W - P '5 and P ' = 1 - (l,^)) is tight by LemmaEU Thus 
the sequence {F^} is also tight. By Prohorov's theorem, this implies {F^* 1 } is 
relatively compact. □ 

5.4. Characterisation of Subsequential Limits. The main result of this section 
is the following theorem. 

Theorem 5.13. Suppose Assumption^ is satisfied and (X,V) is the limit of any 

subsequence of {(X ,77^)}. If either (i) h is continuous on [0, M) or (ii) E and 
Vo are absolutely continuous and the set of discontinuities of h in [0, M) is a closed 
set having zero Lebesgue measure, then (X,V) satisfies the fluid equations. 

The rest of the section is devoted to the proof of this theorem. Let (E, X(Q),Vq) 
be the 5o-valued random variable that satisfies Assumption [TJ For simplicity of 
notation, we denote the subsequence again by N. By Assumption [T] and Theorem 
I5.12[ the associated sequence 

{ (E m , x (N) (0) , , x {N) , fW ,a[ n \ ) } 

is relatively compact. Hence it converges in distribution, along a subsequence that 
we denote again by N, to a limit (E, A(0),F o , X, F, A\,Q-y). We now identify some 
properties of the limit that will be used to prove Theorem 15.131 Appealing to the 
Skorokhod representation theorem, we will somewhat abuse notation and assume 

that (X^ N ,V^ N \ A^\ Qi* ) converges almost surely to {X,v, A^, Q^)- Then, we 
immediately have (l,V iN) ) ^ (1,F), and by (pT0| . (|2~4|) . ([2~5]) and the fact that 
M[ N) => , we infer that the non-idling condition (|3.7[) holds, that 

X = X(Q) +E-Q 1 = X(Q) +E-M 

and that 

K = (1,F.) - (1,F ) +Ai. 

Comparing the last two relations with equations (|3 . 6[) and (|3.8|) . it is clear that in 
order to prove that (A,F) satisfies the fluid equations, one needs to show that Q x — 
A\ = D, where D is defined in terms of F via (13. 9p . If h is continuous and uniformly 
bounded on [0, M) (as is the case, for example, for the lognormal distribution), then 
this is a simple consequence of the (almost sure) weak convergence of V^ N > to F. 
However, additional work is required to justify this convergence for general h that 
is only a.e. continuous on [0, M). As shown in the next two lemmas, this is possible 
under some addditional, but still very mild, assumptions on the initial conditions. 

Lemma 5.14. If Vq and E are absolutely continuous, then so is F s for every 
s e [0, oo). 

(AT) 

Proof. Using the fact that A — > A and Fatou's lemma, the proof of the second 
assertion of Lemma 15.71 immediately shows that A\ is absolutely continuous. For 
simplicity, we will assume that M = oo for the rest of the proof. The case M < oo 
is analogous and left to the reader. Since E is absolutely continuous by assumption, 
the two equations preceding the statement of the lemma allow us to deduce that 
X and K are also absolutely continuous. Fix T < oo, and let C £ denote the set 
of collections of finite disjoint intervals (a,i,bi) C [0,T},i — l,...,n, such that 
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— a i) — £ - Given S > 0, choose e > small enough so that 



sup [Vo(US=i[ai,bi])]^ 

{(a»,6i)}eCe 



sup y K(s — bi,s — cii) 



< 



Now, consider a particular collection {(ai, bi)} £ C e , and define J\ = {i € {1, . . . , n} : 
«i — s > 0} and let J 2 = {!> • • • > i} \ Ji- Then for any s e [0, T], note that we have 

n 

Xy/o (*,&,•) = e^wo + E^ka) 

< Yl - s > b * - s ) + E F -l(°< 5 * - <*) 

- E v Q N \ a i ~ s ' b * - s ) + E K N \ S ~h,s- a^. 

Taking limits as N — > oo and then the max over collections in C £ , and using the 
fact that K —* K, Assumption [TJ 3) and Portmanteau's theorem, we see that 

17.(1^(0,, 60) < limmfvi N HuU(ai,bi)) 

n 

= lim inf v s N ^ (ai, bi) 

i=l 

< lim sup Fq^' [oj — s, 6j — s] + lim if ^ (s — h , s — ai) 

< v (Uiej! [ai - s,bi- s]) + ^2 K ( s -bi,s ~ ai). 

i£J 2 

Taking the supremum over all collections of intervals in C e , we conclude that for 
every 6 > there exists e > such that 



sup \] v s{<H, bi) < 6, 
{(oi,b*)}ec £ } 



which shows that v s is absolutely continuous. 



□ 



Lemma 5.15. Suppose that for a.e. s e [0, oo), h isv s -a.e. continuous on [0, M), 
and for every L < M , there is a sufficiently large C < oo such that the boundary 
of the set {x G [0, L] : h(x) < C} has zero v s measure. Then 



A± = D 



(h, v s ) ds. 



Proof. Fix T e (0, oo). Then for any L < M , we have the elementary bound 



(5.37) 



sup 

te[o,T] 



A[ N) (t) - D(t) < 1 (L) + i# v >(L) + Rl" > (L) , 
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where 



R[ N \L) = 



4 N) (L) 



Ri N \L) 



\J(L,M) 
T 



h{x)v[ N \dx) ds; 



(i 



[O.L] 



h{x)V^\dx) 



[O.L] 



h{x)v s (dx) 



ds : 



la W(L,M) 

Now by Lemma l5.7f l). we know that 



h{x)v s {dx) ds. 



(5.38) 



lim supl 
l^m N 



R{ N \L) 



0. 



On the other hand, since v 
know that 



_(JV) w _ 



for a.e. s £ [0, t], by Theorem A. 3. 12 of [5] we 



{^(L,M)h,Vs) < liminf(l(L,jvf)'i,i / i JV) )- 



Combining this with Fatou's lemma, (|5.38|) , and the fact that is independent 

of N, we conclude that 



(5.39) 



lim E 



^(i) < lim liminfE[i?P(L)] = 0. 



Now fix e > 0, and let L < M be such that 



lim sup E \r[ N) {L) 



N 



< — and lim sup E 
2 N 



4»>(L) 



< 



For this fixed L < oo, choose C < oo large with v s (d{h < C}) = 0, for a.e. 
s e[0,T]. Define now 



hc(x) 



h(x) if h(x) < C 
if h(x) > C 



Then he is bounded by C and so for a.e. s £ [0, T], the fact that v 
Portmanteau's theorem imply 



(N) 



lim 



[O.L] 



h c {x)vi N \dx) - / h c (x)V s (dx) 



[O.L] 



On the other hand, we have 

(h(x) -h c {x))v[ N) {dx) = 



[0,L] 



[o,L]n{/i>c} 



and, likewise, 



[0,L] 



(/i(x) - h c (x)) v s (dx) = 



[0,L]n{h>C] 



h(x)v s {dx). 



and 
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Combining the last three relations and the bounded convergence theorem, we obtain 



lim sup R^\l) 



< sup 

N Jo 



N 

[ h(xp ( s N} (dx)ds+ [ [ h(x)V s (dx)ds. 

l[0,L]n{h>C} Jo J[0,L]n{h>C} 

Given any 6 > 0, the expectations of both terms on the right-hand side are bounded 
by 6/2 for all sufficiently large C - the bound for the first term holding by an 
application of relation (|5.29p of Lemma [5771 while that for the second being a result 
of Fatou's lemma applied to this relation. Since 8 > is arbitrary, this implies that 



lim sup E 

N^oo 



R^>(L) 



= 0. 



Thus we have shown that 



lim^limsupE[flf°(.L) + R { 2 N) (L) + R ( 3 N) (L)} = 0. 



N 



When combined with the bound (|5.37p . Fatou's lemma and the fact that A N — » A, 
this implies that 



E 



sup \A(t) 
te[o,T] 



D(t)\ 



< lim sup E 

JV 



sup \A (N \t) 
te[o,T] 



D(t)\ 



which proves the lemma. 



□ 



Combining the above results, we now have a proof of the main result of this 
section. 

Proof of Theorem \5.13l The conditions of Lemma 15.151 hold trivially if h is contin- 
uous on [0, M). On the other hand, if E and Vo are absolutely continuous, then 
due to Lemma [5J~4] the first condition of Lemma f5. 151 is satisfied if h is a.e. contin- 
uous on [0,M). If, in addition, the set of discontinuities of h are closed then the 
second condition of Lemma 15.151 is also satisfied due to Lemma IB. 11 In either of 
these situations, Lemma 15.151 and the discussion immediately prior to Lemma l5.14l 

shows that 7y —*75 and J33J), {37S]) and (JSH are satisfied. It only remains to 
establish (|3.5[) . Since both y — > ip{y, s) and y — > (p x {y, s ) + l Pt(y, s) are bounded and 
continuous, Assumption |TJ3) guarantees that {ip(-,0),V o N ' > ) (cp(-,0),Vo) and the 
convergence of to v guarantees that for a.e. s £ [0,i], {ip x (-, s)+ip t (-, s),v{ N ^} 
(ip x (-, s) + ipt(-,s),V s ). Thus, dividing ()5.2() by N, letting N — * oo and invoking the 
bounded convergence theorem, we conclude that V satisfies (|3.5j) for all t e [0, oo) 



such that 



v t . Using right-continuity of both sides, we then extend the 



result to all t € [0, oo). Since we used the Skorokhod Representation Theorem, the 
almost sure convergence asserted in the limits above must be replaced by conver- 
gence in distribution. This shows the desired result that (X,V) satisfies the fluid 
equations. □ 



We now obtain Theorem 13.51 as an immediate corollary. 

Proof of Theorem \3.5l The first statement of Theorem l3.5l is a direct consequence 
of Theorem 15.121 The remainder of the theorem follows from Theorem I5.13[ the 
uniqueness of solutions to the fluid equations established in Theorem 13.41 and the 
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usual standard argument by contradiction that shows that the original sequence 
converges to the solution of the fluid limit whenever the latter is unique. □ 



6. Convergence of the Fluid Limit to Equilibrium 

In this section we characterise the behaviour of the unique solution (X, V) to the 
fluid equations, as t —> oo. 

Lemma 6.1. Suppose E is an absolutely continuous, strictly increasing function 
with dE/dt = A(-) and (X,17) is the unique solution to the fluid equations associated 
with the initial condition (£7,0, 0) G So and h. If 

(6.1) n = inf (t > : (1 - G(t - s))A(s) ds = 1 

then we have the following properties. 

(1) Ast^n, 

(l,V t ) = X{t) -» f \l-G(t-s))X(s)ds, 
Jo 

and for every function f G C&(IR+) 7 

(f,vt) -> [ * f(t-s)(l-G(t-s))\(s)ds. 
Jo 

(2) Suppose X is constant. Then, as t — » oo, (l,Pf) — > AA1 monotonically and, 
if A < 1, f/ien Ft — > [A A 1]I7* monotonically, where is the probability 
measure on [0, oo) with density 1 — G(a;), as defined in \3.13\) . 

(3) Suppose (E ,X is the solution to the fluid equations associated with 
any other initial condition [E , x'(0), v n ) G Sq- If e' = E then for all 

ie[o,7i), 

(6.2) (l,V' t ) > (l,V t ). 

Proof. Let (X,T7) be the unique solution to the fluid equations associated with the 
initial conditions (£7,0,0), and define 

t = inf{< > : (l,z7 t ) = 1}. 

Then r > by continuity and for t G (0,r), (l^t) < 1- The non-idling property 
(13. 7p then implies that X(t) = (l,Vt) < 1. Combining relations (|3.6[) and p.8p . we 
see that K(t) = E(t) for t G [0, r). Since 17 and £f satisfy the fluid equation (|3.10|) 
and I?o = 0, Theorem 14.11 shows that for any / G Cb(R+) and t G [0,r), 

{f,V t )= I f{t-s){l-G{t-s))dE{s)= [ f(t-s)(l-G(t-s))X(s)ds. 
Jo Jo 

Substituting / = 1, the left-hand side above is equal to X{t) — (l,T>t), from which 
it is easy to see that r = n . Since the integrand on the right-hand side is continuous 
in t, this proves property (1). 

Now, consider the time-homogeneous setting where A(-) = A is constant. When 
A < 1 or A = 1 and the support of 1 — G is [0, oo), the results in (1) show that 
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ti = oo and v t — + Az^» monotonically as t — > oo. If A > 1, then it is easy to verify 
directly that the unique fluid solution satisfies for every t>T\, 

X(i) = 1 + (A — l)(t — n) and V t =V*. 

Indeed, this is a simple consequence of the fact that with this definition for t > t\ , 
X(t) > 1 and (l,Ft) = 1 = 1 A A. This completes the proof of property 2. 

For the last property we first show that for every t € (0,ti), X (t) > X(t). To 
this end we use (3.6), (3.8) and the non-idling condition (3.7) to deduce that for 
every t, T? (t) < (X (0) - (l,17' Q )) + +E(t). It now follows from and g^) that 

x\t) = x'(0) + E(t)-[ G{ \ +t) ~,S {X) %{dx)- f 9 {t-s)j?{s)d S 

J[0,M) L — U{X) 



ii 



v'm 7=,/, / G{x + t)~G{x) _, ^ 
> X(0) + E{t)- —— v (dx) 

l[0,M) I ~ U{X) 







g(t-s)((X (0)-(l,T/ ))++E(s))ds 

> T(0)+E(t)-(1,V' )- [ E(s)g(t- S )ds-(X'(0)-(1,V' )) + G(t) 

Jo 

> X'(0) + E(t)- [ E( S )g(t~ S )d S -(x'(0)-{l,v' a ))+-(l,v' o ). 



We now recall that the non-idling condition implies that (X (0) — (l,^g}) + + 
(1,Fq) = X'(0) and therefore x'(t) > E(t)-f*E(s)g(t-s)ds = X(t), where the last 
equality follows by combining relations (|3.6|) . (|3.8p . (|4.4|) and the fact that, due to 
(|3~T2)1 . i?(s) = S(s) for all s G [0, n). To prove our result we note that if J?(t) > 1 
then (l,T/ t ) = 1 > (l,F t ), whereas if X'(t) < 1 then (1,^) =X'(t) > = (l,F t ) 
which proves the last part of our lemma. □ 

Proof of Theorem 13.61 The first statement of Theorem 13.61 follows from prop- 
erties (1) and (2) of Lemma 16. II For the second statement of the theorem, consider 
an arbitrary initial condition of the form (A1,^l(0),Fo) €E So for A £ (0, oo), let 
(X, V) be the unique solution to the associated fluid equations and let K and D 
be the related processes defined in ()3.8|) and ()3.9|) . respectively. Since E = Al 
is absolutely continuous, by Theorem 13.41 K is also absolutely continuous. Let k 
denote the derivative of K and also define 

(6.3) 7(t) = l-(l,F t ) forte [0,oo). 



Then Lemma [6.11 shows that I(t) — > as t — -> oo. We now consider the following 
three mutually exhaustive cases. From the proof of Lemma 16.11 it is clear that if 
A > 1 then only Case 2 is possible. 

Case 1. There exists T Q E (0, oo) such that 7(f) > for all t > T . 
In this case, A = 1 and by (|3.12[) , it follows that n(t) = 1 for t >Tq. As a result, 
by Lemma [4.61 and equation (|4.2jl of Theorem 14.11 for any u > and t = Tq +u, 
we have 

(f,V t )= f f(x + u) 1 ~ G{ * + u) V To (dx)+ [ U f(u-s)(l-G(u- S ))ds. 

J[0,M) 1 _ Lr ( x ) JQ 
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Since / is uniformly bounded on [0, oo) and for every x € (0, oo), (1 — G(x+u))/(l — 
G(x)) — > as u — > oo, by the bounded convergence theorem, the first term con- 
verges to zero as u — ► oo. On the other hand, the second term trivially converges 
to / °°/(x)(l — G(x))dx = (f,V*) as u — > oo, which completes the proof of the 
theorem in this case. 

Case 2. There exists T < oo such that I(t) = for all t > T . 
In this case for all u > 0, (1,Vt + u ) = (Ij^To) = 1- Together with Corollary 
and Lemma 14.61 this shows that for every u > 0, 



K(T + u) - A' (To) 

G(x + u) - G(x) 



v Tq (dx) + g(u- s) (K(T Q + s) - K(T )) ds 



o \J[0,M) 1 - G{x) 
g(x + u) 



[Q.M) 1 ~ G( x ) 

G(x + u)-G(x) . p . , m 

' / T7 To (dx) + / G(u - a)7s To + s) ds, 

[0,M) 1 - G(x) 7 

where the last equality follows by integration by parts. Differentiating the last 
equation with respect to u, we obtain the renewal equation 

r a (x + u) f u 
k(T q + u) = / r n( \ V T a {dx)+ / g(u - s)k{T q + s) ds. 

J[0,M) 1 _ ^■\ x ) JO 

Since g is directly Riemann integrable by assumption, an application of the key 
renewal theorem (see pQ) and Fubini's theorem yields the relation 

lim k(To + u) = f ( I ^ — ~^ T o (d x )^J du 

du)v To (dx)=V To ([0,M)) = l. 
I[o,m) \Jo l-G(x) J 

Now fix e > and choose Tq < oo such that \k(Tq + u) — 1 < £ for every u > 0. 
Then (|4.2p and another application of Lemma [4.61 show that for any / 6 Cb(K+) 
and any t = + u with u > 0, we have 

(j> t )= / /(x+h) 1 ~ f U f(u-s)(l-G(u-s)Mn+s)ds. 

J[0,M) l-G(x) J 

Sending u — > oo, and thus t — > oo, since 1 — G(x + t)^0, Ft is a probability 
measure on [0, M), and / is uniformly bounded on R + , the first term on the right- 
hand side converges to by the bounded convergence theorem. On the other 
hand, since 1 — G is a probability density, / is uniformly bounded on [0, oo), and 
\k(Tq + s) — 1| < e for all s > 0, another application of the bounded convergence 
theorem shows that 

poo 

lim (/,!?*)- / /(a?)(l-G(a!))da! -O(e). 
Sending e — » proves the theorem in this case. 

Case 3. For every T < oo there exists s,t >T such that I(s) > and I(t) = 0. 
In this case, for every e > there exists T e > such that I(T e ) — (or, equivalently, 
(1,Vt e ) = 1) and I(t) < e for all t >T £ . The latter assertion follows from Lemma 
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16.1( 3) and the fact that (l,^t) — > 1 as t — > oo, as proved in Lemma [6.1( 2). For 
u G [0, oo), define 



K [1 \u) = K(T £ + u)~K(T e ) 



and 



K (2 \u) = D(T e +u)-D{T e ), 



and note that by relations (|3.8|) and (|3.9[) . it follows that 



(6.4) 



sup 

uG[0,oo) 



< e. 



Now, for i = 1,2, let k^- 1 denote the derivatives of respectively, and set 

= vt +«• Then equation (|4.2p . with Z = K 1 and Lemma 14.61 imply that for 

/eC b 1 (M+), 



f{x + u) l ' G ^ u) v Tc {d x ) 
[o,m) 1 - 

f(t - s)(l - G(u - s))k (1) (T e + s) ds. 



Next, we define k^ 2 \-) = {h, v.) to be the departure rate and let be the measure 
on [0, oo) that satisfies the last equation for every / € C&(R+), but with K«r eplaced 
by k^ 2 \ Also, note that Corollary 14. 3( relation ()3.8() and Lemma l4~6l imply that for 
u > 

G(x + u)- G{x) 



V Te (dx)+ I G(u-s)K ( - 2) (T e +s)ds 



K {2) (T e +uyK {2 \T £ )- , , 

[0,M) 1 ~ Lr ( x ) 

The same arguments as in Case 2 can then be used to show that Tt^ 2 ' satisfies the 
renewal equation 



n {2 \T e + u) = f f 

JlO.M) L 



9( - X + U) V Tc {dx) + I g{u-s)K^{T £ + s)ds, 



and hence that, for every / G C(,(R + ), ~R,( 2 \t) — > 1 and (f^V^) — » (f,V*) as i — > oo. 
On the other hand, comparing the equations for (f,V^), i = 1,2, given above, 
using Lemma l4~4l and the bound (16. 4|) . we have for every / G C^J(R+), 

(/,77 (1) )-(/^ (2) ) <(2||/|| 00 + ||/'|| 00 ) £ . 

oo 

Since e — > 0, this proves the property for Case 3, and thus concludes the proof of 
the theorem. 



Appendix A. Explicit Construction of the State Process 

In this section, we provide an explicit pathwise construction of the state process 
(iZj^.-XW.i/W) and auxiliary processes described in Sections 12.11 and 12.21 

Suppose that we are given the sequence of service requirements {vj, j G {— N + 
1, . . . , 0} U N} and initial conditions i/q N ^ and X^ N \0) satisfying 

N-(l,vg f) ) = W-X W (0)] + , 
as well as the residual inter-arrival process that takes values in 2?u + [0,oo). 



Here, is a sum of (1, v$" ') < N Dirac masses. Let oV" ' 1 '(0), j = — (1, Vq"') + 1, 
— (1,1/^) + 2, ... ,0 be the positions of the Dirac masses, ordered in increasing 
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order. Then represents the age of the jth customer and so we can assume, 
without loss of generality, that each < Vj and hence write 



"O^ = E S a' N \0) = E <5 a< JV )(0) 1 la ' 



(o) - x (°) {°r (°)<m- 



The cumulative arrival process E( N ^ is easily reconstructed from R^'- E( N \t) is 
simply the number of jumps of R^ in [0, t] and is thus adapted with respect to 
the filtration generated by R^ . The evolution of the processes X( N ) and i/W 
can then be described recursively as follows. Define To = Tq ' = 
Q ; K( N \0) = 0. Since the ages of customers that have already entered service 
increase linearly with time while in service, for I = and j e {-{v { Q N) ,l) + 
1, -(v { N \ 1} + 2, . . . , KW(n)h wc define 

n , , j af>(7,)+t-7i ifof ) (t)<« j 



(Al.l) ay'U) 
Also, wc define 



otherwise. 



(A1.2) d"W(t) = E V N) M>M f « r *e [77,00). 



{«r'w>»i} 

J= -(,W,1>+1 



The process d\ , defined on [77, oo), represents the cumulative departure process, 
assuming there are no new arrivals into the system after 77. Now, let 77+1 = rffl 
be the first time after 77 when there is either an arrival into or departure from the 
system. Since 77 + R^ (77 ) is the first time after 77 that there is an arrival into the 
system, we have 

(A1.3) 77 +1 = [77 + R^in)] A inf [t > n : d\ N \t) > D^ N \ n )} . 

By assumption, we have a^ N) (0) < Vj for j e {- (v^ N) , 1) + f , . . . , 0} and E^ (0) = 

0, and therefore it follows that d ( N) (0) = = J)W(0). Hence for t e [77,77+1], we 
set 

(A1.4) D (N Ht) = 4 N) (t) 

(A1.5) af \t) = forj > K^ N \ n ) 

(A1.6) = #)(0) + #»(()-#»((). 

In addition, for t G (77,77+1], the quantity K^ N \t) is defined in terms of X^ N \t) 
and (f ) via the relation 

(A1.7) K^ N \t) = D^ N \i) + X^ N \t) AN- lC)(0) A A^ 

and, in turn, u^ N \t) is defined in terms of and {a^} by 

if< N >(t) 
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This defines the processes X^ N ' and v^ N ^ on [0,17+1]. 

To proceed with the iteration, first note that since E^ N ^ (77+1), X^ n \ti + i) and 
dj N \j S { — (1, Vq ) + 1, . . . , K( n \ti+i)} are now well-defined, dj^l and 77+2 are 
also well-defined by equations (|Al.2j) and (|Al .3j) . Therefore, replacing I by I + 1, 
the recursive relations above can be used to extend the definition of the processes 
ZW and i/W to [0 , ti + 2\. In order to show that this procedure can be used to 
construct the process (R { e\x( n \ i/W) on the whole of [0, 00), it suffices to show 
that t ; — ► 00 a.s. as I — > 00. To see why this is true, note that arrival and departure 
events are generated by either the departures of one of the XW(0) customers 
already present at time or by the arrival and/or departure of a customer that 
arrived after time 0. Thus for I departure or arrival events to have occurred, there 
must have been at least (/ — X( N ' (0))/2 new customer arrivals after time 0. In 
other words, 77 > C^[(i_x< JV )(o))/2]vo> where Uj is the time of arrival of the jth 
customer after time 0. Since X^ N '{0) is a.s. finite and U\ — > 00 as I — > 00 due 
to the assumption that E^ N \t) is finite for all t finite, this implies that 77 — > 00 
a.s. as I — y 00. Therefore the initial conditions, along with the recursive equations 
(lAd3|) - (jAL8]) . define a.s. every sample path of E<- N \ X^ N ~> and i/<W on [0, 00). 

Remark A.l. The above construction shows that the auxiliary processes satisfy 
relations (f2Ti]) - ([2~T(j]) . Indeed, equations (|2~i|) . ([23)1 and (|2~7)l are an immediate 
consequence of (|A1~6|) . ([ATT]) . (|A~1~5]) and (|A~L8|) . Moreover, relations (|A~1~2|) . 
(|A1 .4|) and (|A1 .8|) . when combined, yield relation (|2.5p . In turn, equations (|2.5[) 
and (IA1.7[) show that the idle server process 

T (N) = N _ (l,is {N) ) satisfies the 

non-idling condition (|2.10p . 

Remark A. 2. From the above construction, it is also clear that the value of 
(Rj2,X( N \ i/W) does not depend on the method of assignment of customers 
to servers, as long as the non-idling requirement - that a server never be idle when 
there is a customer that needs service - holds. In order to implement any specific 
assignment policy, one may need to keep track of additional variables. For example, 
if one were to consider a random assignment of an arriving customer to idle servers, 
then one would have to enlarge the probability space to accommodate an infinite 
sequence of i.i.d. random variables, uniformly distributed in (0, 1), that will be used 
to implement this random choice. In this case, the filtration T Tl would have to be 
enlarged to include the uniform random variable that makes this choice, resulting 
in a corresponding enlargement of the filtration J-[ N \ On the other hand, if one 
were to assign a customer to the server that has been idle the longest since it last 
completed the processing of a customer, then one would have to keep track of the 
identities of individual servers and the time elapsed since completion of their last 
completion of service. Since these details do not play a role in our analysis, we omit 
them. 

Appendix B. An Elementary Lemma 

Lemma B.l. //, for every L G (0, 00), the set of discontinuities of a function h on 
[0, L] is a closed set of zero Lebesgue measure, then for every C < 00, the boundary 
of the set 

{x G [0,L] : h(x) < C} 

has zero Lebesgue measure. 



FLUID LIMITS OF MANY-SERVER QUEUES 



5.5 



Proof. Let J be the set of discontinuities of h on [0, L\. Since J is closed, [0, L] \ J 
is open and therefore admits a representation as a countable union of open intervals 
Ui(cii, bi). Thus for any C < oo, we can write 

{x £ [0, L] : h{x) < C} = [Ui£y U {x G J : %) < C*} 

where 

O l = {x G (ai,&i) : fe(x) < C}. 

This implies that 

<9{a; G [0, L] : h(x) < C} C [U^O,] US{ieJ: < C} C [1^.90;] U J, 

where the last inclusion follows due to the assumption that J is closed. Since J has 
zero Lebesgue measure by assumption, to prove the lemma it suffices to show that 
each dOi has zero Lebesgue measure. For each i, since h is continuous on (aj,&i), 
the set Oi is open and can therefore be written as a countable union of intervals. 
Its boundary is therefore at most countable and so has Lebesgue measure zero. □ 
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